Dengar's Blog Logo

Dengar's blog...
We will see what I post, probably will be some random tutorials

Saturday, 10 May 2014

Removing unused Kernel files via command line

regular kernel updates are great, but having 3 years of kernel updates on one hard disk is not. chances are you are never going to use any of the 10 or 20 that you installed last year. if everything continues to work fine, why would you?

you can obviously use a package manager, such as synaptic, to uninstall unwanted programmes. quite often you might find a few other programmes that you didn't know you had still and want to get rid of. but it's generally easier to just use the command line to remove things quickly.

use this command:

dpkg -l 'linux-*' | sed '/^ii/!d;/'"$(uname -r | sed "s/\(.*\)-\([^0-9]\+\)/\1/")"'/d;s/^[^ ]* [^ ]* \([^ ]*\).*/\1/;/[0-9]/!d' | xargs sudo apt-get -y purge 

i use this command in ubuntu and i'm pretty sure it will work in derived versions, but results may vary!

Bulk encode MP3s with Lame and avconv

to be honest, when i am in the car or listening to music at home, i don't really hear the difference between "lossy" mp3s and lossless formats such as flac. flac is just really huge compared to MP3 and i wouldn't care if hard disk space was unlimited.
even if buying 2-3 nat storage devices, i think i'd still run our of space eventually.

so i do compress flac files after a while. but doing a whole album that is correctly labelled and tagged can be tricky. you don't want to use some software that renames the files or changes the tagging...

linux is very supportive for doing things like that via the command line:

what you need is avconv and lame. avconv is a very fast video and audio converter. it can use libmp3lame to encode to mp3. because avconv can also convert and optimise video files, you can use it the same way to strip mp3s from video files, such as music videos or stuff you downloaded from youtube. but this post is about mp3s.
lame ain't an mp3 encoder, but it simply is the best of them.

the command line argument to convert all flac files to mp3s in one folder is:
for file in *.flac; do n=$(basename "$file" .flac); avconv -i "$file" -codec:a libmp3lame -qscale:a 2 "$n".mp3; done
if you want to convert from a different format, simply exchange the ".flag" to a ".wav", ".mp4", ".swf" or whatever the source file might be.


Sunday, 2 February 2014

Exporting Sound with XDMCP

Some of you might be connecting to your remote linux box using XDMCP. While that would export the display,what would one do if one wanted to play a song on the remote box but hear it on the present system? well that can be easily done using the arts server on the remote machine setup the arts daemon by typing
artsd -n -u -p 5001
once the server is started change to the X display of the remote machine and type in
export ARTS_SERVER=ipofcurrentsystem:5001

and then

xmms &
Voila you will have a complete remote desktop including sound just like in windows xp.

Friday, 20 September 2013

Excel reverse string function (VBA)

a very simple VBA funciton to reverse a string (text cell) in Excel:

Function Reverse(str As String) As String
    Reverse = StrReverse(Trim(str))
End Function


Thursday, 11 July 2013

Keyword Categorisation for PPC Search Engine Marketing

sometimes it's strange that you never get to think about creating a solution for a manual task that you have to do, even though it would be totally easy to do.
such for me was building a tool that categorises keywords... i have probably categorised keywords manually for way too long, probably 10s of thousands of keywords. often i cut corners, often i would just wrap keywords into an ad group by the way that i generated them, running a quick sense check if the keywords are in the right place.

it turns out that the way that i was doing this was actually quite straight forward: i look at the keyword and decide, based on a few key phrases, what category i would map that keyword too. let's take an example. the company i (hypothetically) work for is an airline with the name paddyjet:

  • i have brand terms, ie: paddyjet, paddy jet and so on and so forth.
    everything that has these words or 'paddy' in them will be brand terms, with the possible exception of keywords that have the word 'review' or 'compare' in them. maybe i also want to exclude the words 'contact' and 'customer service', as they too should be in another category called 'paddyjet cs terms'
  • i have competitor terms that i may or may not want to bid on: british airways, ba, delta, - i would probably want to create a rule with these other brand terms and put them in another category, again with the exception of 'review' and 'compare' terms
  • there are the 'review' and 'compare' type terms
  • budget type terms will probably have the terms 'cheap', 'discount', 'bargain', 'low cost' and so on
  • cs terms should be our brand name and the words like 'customer service', 'contact', 'complaints'...
in short, there are rules in your mind that make you decide quite instantly where to put terms. these rules are:
  • must include this word
  • must exclude these words
  • must include these words and these words
so i wrote a little python script to categorise keywords based on your rules. click on the link to go to my website and get the file and also samples
it needs the list of keywords in a text file (default keywords.txt), a list of noise words to remove (default: noiseWords.txt - it is optional to provider content in this file, the file itself has to be there) and the categorisation rules file (default keywordCategories.txt). 
the rules file needs to be marked up and structured in an ordered way:
  • more important rules need to go at the top
    ie: paddyjet tickets - if you rather want this in the 'brand terms', then put the brand rules first. if you rather want this to be categorised as 'ticket terms', then put this one first
  • one line per rule - no exceptions
  • start the line with the category name, followed by a colon (:)
  • words that mean the keyword does not fit in this category need to be in curly brackets ({...})
  • words that need to in combination with the term need to be in hard brackets ([...])
  • you can create combinations of words that need to be included and the search term.
    ie: you have vanity urls that you wish to treat different from brand terms ('flypaddyjet', 'premierpaddyjet' or paddyjetbusiness). simply put a tilde at the required position. ie:
    vanity urls: [premier~, ~premier] paddyjey, tickets, bookings, paddy
    will create the word combinations:
    premierpaddyjet, premiertickets, premierbookings, premierpaddy, paddyjetpremier, ticketspremier, ...
finally, anything that can't be categorised as 'unknown'.

at the end a file will be generated with three columns: the original keyword, the noise words removed and the category based on the rules. the default name of the file would be date-time stamped and look like: YYYYMMDD_HHMMSS_categorisedKeywords.txt

i hope this tool could be useful for some people in digital marketing who currently struggle to categorise thousands of keywords manually. contact me if you have any questions, i'm happy to help.

it's a very quick and dirty solution, so if you have problems, find bugs or would like more features, feel free to contact me. 

Thursday, 6 June 2013

Using AJAX to read XML

arguably not the wisest of all implementations of an AJAX, i have prepared a page on my personal website (http://www.matenaers.com/chris/chris-matenaers.html) to put my CV online - at least a basic version.

i finished with the code, but still have to fill in the rest of the xml file to complete this task. this will change the content of a div on hovering over another div...

finally, this here is code only, apologies. ask questions if you have to.

here is a copy of the solution:

xml part:
<?xml version="1.0" encoding="UTF-8"?>
<lvl1>
    <lvl2 id="aaa">
        <lv3a attrib="test_attribute">node_text</lv3a>
        <lvl3b><![CDATA[
            Some data not parsed
            ]]></lvl3b>
    </lvl2>
</lvl1>


and the html & javascript:
<script>
function getXML(url) {
var xmlhttp;
var txt = "";
var x,xx,i;
if (window.XMLHttpRequest) {
xmlhttp=new XMLHttpRequest();
}
else {
 xmlhttp=new ActiveXObject("Microsoft.XMLHTTP");
}
xmlhttp.onreadystatechange=function() {
if (xmlhttp.readyState==4 && xmlhttp.status==200) {
x = xmlhttp.responseXML.documentElement.getElementsByTagName("lvl2");
for (i=0;i<x.length;i++) {
txt = txt + "<br />Attribute lvl2 : " + x[i].getAttribute('id');
xx = x[i].getElementsByTagName('lv3a');
txt = txt + "<br />Node value lvl3a : " +  xx[0].firstChild.nodeValue;
txt = txt + "<br />Attribute lvl3a : " +  xx[0].getAttribute('attrib');
xx = x[i].getElementsByTagName('lvl3b');
txt = txt + "<br />Node value lvl3b : " +  xx[0].firstChild.nodeValue;
}
document.getElementById("change_me").innerHTML=txt;
}
}
xmlhttp.open("GET",url,true);
xmlhttp.send();
}
</script>
<h1>Chris' Sandbox</h1>
<div id="mainpage">
<div id="content" class="text">
<h4><a href="#" onmouseover="getXML('http://www.matenaers.com/chris/code/sample_xml.xml')" onclick="return false;">Hover here!</a></h4>
<hr/>
<div id="change_me"> test </div>
</div>
</div>

Thursday, 25 April 2013

PHP Image Resizer Class


class imageResizer {
var $newImage;

function getSquareImage($size, $image) {
//getting the path and resetting to the new path of the image
$oldPath = explode('/', $image);
$t = sizeof($oldPath) - 1;
$i = 0;
while ($i < $t) {
$newPath = $newPath . $oldPath[$i] . '/';
$i++;
}
$filename = str_replace('.gif', '', end($oldPath));
$filename = str_replace('.jpg', '', $filename);
$filename = str_replace('.png', '', $filename);
$filename = str_replace('.JPG', '', $filename);
$filename = str_replace('.jpeg', '', $filename);
$newPath = $newPath . 'cache/' . $filename . '_sq'. $size .'.jpg';

//if that image does not exist already (we haven't resized it before):
if(!is_file($newPath)) {
list($width, $height) = getimagesize($image);

//check if the image has the right propotions or do:
if ($width > $size || $height > $size) {
if ($width > $height) $ratio = $size / $width;
else $ratio = $size / $height;

$new_width = round($width * $ratio);
$new_height = round($height * $ratio);

$newImg = imagecreatetruecolor($new_width, $new_height);
$imageTmp = imagecreatefromjpeg($image);
imagecopyresampled($newImg, $imageTmp, 0, 0, 0, 0, $new_width, $new_height, $width, $height);
imagejpeg($newImg, $newPath);

$this -> newImage = $newPath;
}
//If the original image is the correct size:
else $this -> newImage = $image;
}
//set this orignal imaget the image returned:
else  $this -> newImage =  $newPath;
return $this -> newImage;
}

function getImageDimensions($sizeX, $sizeY, $image) {
//getting the path and resetting to the new path of the image
$oldPath = explode('/', $image);
$t = sizeof($oldPath) - 1;
$i = 0;
while ($i < $t) {
$newPath = $newPath . $oldPath[$i] . '/';
$i++;
}
$filename = str_replace('.gif', '', end($oldPath));
$filename = str_replace('.jpg', '', $filename);
$filename = str_replace('.png', '', $filename);
$filename = str_replace('.JPG', '', $filename);
$filename = str_replace('.jpeg', '', $filename);
$newPath = $newPath . 'cache/' . $filename . '_'. $sizeX .'x'. $sizeY .'.jpg';

//if that image does not exist already (we haven't resized it befoe):
if(!is_file($newPath)) {
list($width, $height) = getimagesize($image);

//check if the image has the right propotions or do:
if ($width > $sizeX || $height > $sizeY) {
if ($width > $height) $ratio = $sizeX / $width;
else $ratio = $sizeY / $height;

$new_width = round($width * $ratio);
$new_height = round($height * $ratio);

$newImg = imagecreatetruecolor($new_width, $new_height);
$imageTmp = imagecreatefromjpeg($image);
imagecopyresampled($newImg, $imageTmp, 0, 0, 0, 0, $new_width, $new_height, $width, $height);
imagejpeg($newImg, $newPath);

$this -> newImage = $newPath;
}
//If the original image is the correct size:
else $this -> newImage = $image;
}
//set this orignal imaget the image returned:
else  $this -> newImage =  $newPath;
return $this -> newImage;
}

}