Sunday, October 28, 2007

Back to the Future?

Startet to work on a new project at a german autombile manufacturer last week where we'll work with commerical test tools again. It will be very interesting to compare the experiences we made with Ruby/WATIR earlier this year to working with tools like QTP this time.

Friday, October 05, 2007

Grab the 1st issue of the Python Magazine for free!

it kinda made his way through the blogosphere already, but in case you missed it, heres the link. I didn't have t he time read any of the articles but i looks pretty promising

Wednesday, September 26, 2007

GTAC Presentations online

for those who missed it on the mailing list: Allen Hutchison has made the presentations from gtac avilable online

Thursday, September 20, 2007

Some Thoughts about Ruby, Watir, IronPython, WatiN and Unicode

We had some trouble with ruby and some unicode testing lately @work. While the ruby based library for IE test automation Watir still is a great tool in my opinon, Ruby became a real pain :-( My decision to use Watir for that project in question also made the decision for ruby ( so much for the simple logic ;-)). At first i really enjoyed the great flexibility ruby gave me while implementing our test framework but Ruby had some serious (and expensive) downsides as well

  • Ruby may be very popular and well known among web developers because of Rails but its is rather unknown among test engineers. Most of my team mates in that project first had to learn Ruby and its' (sometimes weird, sometime beautyful) syntax
  • There may be many web related ruby libs arround (again because of rails) in other areas it seems sometimes very premature
  • Unicode support sucks in Ruby (maybe i underestimated how important unicode really was for our project and i expected Ruby just to support it properly - silly me)
  • The "flexible" syntax of Ruby makes Code less comprehensive and sometimes harder to debug or to maintain in my Opinion - but it was always fun coding those in the first place ;-)
I did know about WatiN and Watij, the .NET/Java Ports of Watir (for some reason those didn't seem "cool" to me - more on that later) and of cPamie which is a Python lib similar to Watir (but it seemed kinda "dead" - the watir community on the other hand was most alive and the mailing list was always very inspiring - thanx guys :)) and we already did a prototype/proof of concept using Selenium-RC (which wasn't very stable at that time and had issues with HTTPS but would have been language independant - I did choose Ruby on that proof of concept as well however...). I chose Watir because it seemed to be more up to the task than the alternatives.

One of the requirements we had to meet was verifing UTF-8 encoded strings on the web interface of the SUT against values from ASCII Java *.properties files which were encoded in the escaped unicode encoding (\uXXXX). Languages like Java, JavaScript or Python do support that encoding out of the box Ruby on the other hand doesn't (or we didn't find anything that does). We did spend some man-hours on that problem and came up with the following hack for Ruby's String class as solution which does work good enough for us:


class String
# returns a str with unescaped unicode sequence
def unescape_unicode
# fetch the escaped unicode sequence and convert to hex:
self =~ /\u([0-9a-fA-F]{4,8}?)/ ? self.gsub(/\\u[0-9a-fA-F]{4,8}?/, [$1.hex].pack("U*")) : self
end

# replaces the escaped unicode sequence inline
def unescape_unicode!
# fetch the escaped unicode sequence and convert to hex:
self.gsub!(/\\u[0-9a-fA-F]{4,8}?/, [$1.hex].pack("U*")) if self =~ /\u([0-9a-fA-F]{4,8}?)/
end
end

The "set" method of "text_field" objects didn't like UTF-8 chars at all which caused us a another headache. Željko Filipin discribes a workaround for that problem in his blog. Conversion of strings into another encoding is not really well supported in Ruby either. At least there was a wrapper lib for Iconv available.

Beside from the unicode problems we have found some other problematic areas in Ruby which nearly did render the language as too premature for use in production. I know there are many ppl out there using Ruby in production systems (mainly Rails apps - there's a big community and it seems to work just great) and it does work for us now as well after some extra work (which was really PITA sometimes - but some coffee can make a test engineer almost unstopable).

On the bright side the trouble caused by Ruby did enflame my deep love for Python again which is now my first choice programming language again :-) After all that buzz about dynamic languages like Ruby and Python on the two big VMs .NET/Mono and JVM (seems like Sun has some serious plans for JRuby - same goes for Microsoft with IronPython) i deceided to give IronPython a try. With our recent unicode problems in mind i wrote a mini script to check if IronPython + WatiN could handle those encodings out of the box:


import clr
clr.AddReference('WatiN.Core')

from WatiN.Core import *

ie = IE()
for s in ['Przegląd', u'\u00fc', unicode('\305\204', 'UTF-8')]:
ie.GoTo('http://google.pl')
ie.TextField(Find.ByName('q')).TypeText(s)
ie.Button(Find.ByValue('Szczęśliwy traf')).Click()
ie.Close()


What can i say, it worked like a charm. The Reasons why I didn't consider WatiN or Watij before was because i somehow thought the time of languages like Java or C# was up and that dynamic languages like Ruby or my beloved Python should rule the world ;-) I didn't really realize the potential of dynamic languages on top of those mature enterprise class production ready platforms .NET or Java - silly me! ;-)

Actually, what the mini script from above does would probably be possible with CPython and cPamie as well (didn't check) . So no need for .NET there? Well, i just trust WatiN more than cPamie and I was really curious about IronPython. I guess i'll give Jython or JRuby and Watij a try as well (and mybe even IronRuby/JRuby) and post some of the discoveries to this blog...

BTW: An interesting aspect of dynamic languages on .NET/Java ist the current discussion about removing (or not) the global interpreter lock (GIL) from CPython - Ruby2.0 will have a GIL as well - /Iron[Python, Ruby]/, Jython or JRuby don't have this "limitation"....

so whats the point? I guess i have to change the way i think about Java/.NET on one Side and Python/Ruby on the other. Java and .NET are cool platforms from which my work can benefit greatly without losing the fun that dynamic languages (can) provide... maybe JRuby could make me love Ruby again... we'll see

Wednesday, August 29, 2007

Google Test Automation Conference talks online

The videos of the talks from last weeks Google Test Automation Conference (gtac) in NY have been on YouTube for a few days now (you can find a playlist here or use the embeded viewer below).





I haven't had the time to watch them all yet, but i hope i'll be able to catch up soon. Many Attendees of the conference have blogged about their experience at gatc. Kumar McMillan gives a nice summary on his blog. The techtalks from last years conference were quite good, so i guess won't regret watching the new ones :-)

Sunday, August 26, 2007

Music to automate Tests by

While a colleague of mine used to listen to Ennio Morricone during the execution of a load test - i always prefered rather harsh sounds like Death Metal when i was watching my army of virtual users marching into battle ;-)

Now that i'm older and (not that much ;-)) wiser it's Prog Rock what i enjoy most as soundtrack to my daily work. I noticed this the first time when i was working on automated regression tests for a german eGovernment project (which was sadly a little bit too often featured on the german IT news site heise.de.). Albums of bands like Sieges Even and Riverside made my day during that time :-)
So, what sounds do you enjoy during your daily work as a test engineer? If someone actually is reading this blog, feel free to use the comments to this post for a reply... ;-) 

Thursday, August 23, 2007

Architectures of massive Websites

After my little Rant the other day, lets talk about something really cool. Having worked on a few load tests projects (mostly "enterprise" software like CRM and ERP), i find it quite remarkable how sites like Flickr, YouTube, Digg or LiveJournal can handle (extremely) high traffic with lots of inexpensive hardware and mostly open source software. The enterprise products on the other hand are often far away from beeing allowed to be mentioned along the word 'performance' in the same sentence ;-) (but heh, that's not too bad since it does mean more work for us load test guys :-))


I found this nice Google Techtalk about the YouTube architecture, which is really worth watching.




Another nice source for informations on the architectures of those high traffic web2.0 sites is High Scalability

Update: oh, did i mention that YouTube build their appserver in the beautiful Python language... ;-)

Monday, August 20, 2007

Nothing but Managers...

alright, it has been a while since my last posting to this blog... well, here we go after several months of absence ;)

Chris McMahon talks in the last post on his blog about something that seems to be symptomatic for our business nowadays: There are too many managers around and everyone (well, almost everyone...) wants be one of that lot. OK, getting paid like a manager certainly doesn't seem to be a bad thing ;)

On the other hand most big IT consulting companies are "struggling" from too high personnel costs (with all their managers, which are usually not that productive, since they "only" manage the productive staff). So whats their masterplan? offshore outsourcing! The "expensive" onsite staff has to become managers as well of course - instead of beeing productive as an expert in the actual doing (doing? wazzat? i know meetings, reporting and did i mention meetings? but doing... puh... dunno).

so it's only too understandable why it's getting harder to find real experts for a job instead of one of those manager guys. having that said i should add that i took (and passed :-)) the ISTQB advanced level - test management exam earlier this year (along with some colleagues @work) - with not much perspective in the doing way (remember: "experts" are hired in India nowadays) we have to play after the rules after all i guess. misa sad :-|