Here is the obligatory ‘Happy New Year’ post, if a little late. The site also has a new look for the new year.

Making some decent progress with Pry lately, a web based search engine that I am writing for my Uni final year project. I pretty much have the basic search functionality working without problems, and now need to work on some more advanced crawling techniques and some stuff to improve searching like stemming and page ranking. I was a bit concerned about the speed of performing searches and indexing while initially designing the system, but thanks to python and the Berkeley DB libraries the whole thing should be pretty scalable. I’ll upload a working demo here shortly.

Back to Uni on Sunday for another term so progress should speed up a bit.