The Ultimate Benchmark Challenge – SoloPDA Special
– SoloPDA Special – page 1
The Ultimate Benchmark Challenge:
30 Windows Mobile 5.0 PDAs compared.
Aesthetics, size, reliability, build quality, features, post-sales assistance and included accessories: these are only some of the many parameters that are normally considered when you’re in the market for a new PDA. We at SoloPda give particular importance to hardware performance, as this is usually a clear sign of efficiency and reliability. That’s the underlying reason for why all the devices that find their way into our offices are immediately paced through our performance benchmark tests. In order to preserve coherence and continuity, we always use the same identical measuring tools, in our case the software application from Spb, aptly called ‘Benchmark.
Click on the image to view the entire article.
The sheer quantity of devices that we have tested over the last months has grown quite remarkably, so much so that we have now reached the point in which we are able to pass judgement on the highs and lows of each device. This current review actually places 30 Windows Mobile 5.0 devices in a direct side by side comparison. Although we humbly think that this achievement alone is probably some sort of first-time record, we’d rather dwell on the fact that this experimental review method will hopefully be considered as a fresh outlook on a market that is in rapid technical evolution.
How much have PDAs evolved over these last years and what exactly has changed? Do the hardware configurations of the latest devices show true signs of progress? If we are to talk of evolution in the Pocket PC world, which factors can be most accredited with pushing the envelope? We’re modest enough to realise that the following test results do not give the final answers, but we at least hope that they provide a starting point for further discussion and considerations from our readers.
So, after our introduction it’s time to actually get down to business and start our ‘PDA Challenge’, but not before giving a brief mention of the four newcomers that will battle it out with the old guard: introducing the Mio P550, the E-Ten Glofish brothers X500 and M700, and finally, the recently introduced HTC Advantage X7500, alias Athena!
All 30 handhelds are primed, charged and ready to warm their microchips: Clock on to see the race!
{loadposition gnam}
– SoloPDA Special – page 2
The Ultimate Benchmark Challenge:
30 Windows Mobile 5.0 PDAs compared.
The Ultimate Benchmark Challenge:
30 Windows Mobile 5.0 PDAs compared
Here’s the complete starting grid of all 30 Devices with Windows Mobile 5.0, complete with links to individual reviews or technical specifications for every one of them:
Fujitsu Siemens C550 (review), Dell Axim X51 (review), Asus A636 / A632 (review), Hp rx1950 (review), Fujitsu Siemens T830 (review), Qtek 9000 ( i-mate JasJar review), Qtek 9100 ( i-mate K-Jam review), HP hx2490 (scheda tecnica), Fujitsu Siemens N520 (review), Mitac Mio A201 (‘on the road’ test), Dell X51v (ROM 04) (scheda tecnica), i-mate JasJar (review), i-mate K-Jam (review), HTC TyTN (review), Qtek S200 (review), Mio A701 (review), HTC P3600 (review), i-mate JASJAM (review), Fujitsu Siemens N560 (review), Acer N311 (review), Dell X51v (tech specs – double ROM), HP hx4700 (technical specifications), Palm Treo 750v (review), HTC P3300 (tech specs), HTC P4350 (tech specs), Mio P550 (tech specs new!), Glofiish X500 (tech specs new!), Glofiish M700 (tech specs new!), HTC Advantage X7500 (tech specs new!).
Of course, sometimes pictures can speak more than a thousand words so we’ve also included images of all those devices:
 Fujitsu Siemens C550 (review) |
 Dell Axim X51 (review) |
 Asus A636 / A632 (review) |
 Hp rx1950 (review) |
 Fujitsu Siemens T830 (preview) |
 Qtek 9000 ( i-mate JasJar review) |
 Qtek 9100 ( i-mate K-Jam review) |
  HP hx2490 (scheda tecnica) |
 Fujitsu Siemens N520 (review) |
 Mitac Mio A201 (‘on the road’ test) |
 Dell X51v (ROM 04) (scheda tecnica) |
 i-mate JasJar (review) |
 i-mate K-Jam (review) |
 HTC TyTN (review) |
 Qtek S200 (review) |
 Mio A701 (review) |
 HP hx4700 (tech specs) |
 i-mate JASJAM (review) |
Fujitsu Siemens N560 (review) |
 Acer N311 (review) |
Dell X51v (2 ROM) (scheda tecnica) |
 HTC P3300 (scheda tecnica) |
 Palm Treo 750v (review) |
 HTC P4350 (tech specs) |
 Mio P550 (tech specs) |
 HTC P3600 (review) |
 Glofiish X500 (tech specs) |
 Glofiish M700 (tech specs) |
 HTC Advantage X7500 (tech specs) |
Our benchmark tests can actually be divided into four separate phases. First off, we’ll analyse the speed and behaviour of the CPU (Central Processing Unit) inside each handheld. Then we’ll scrutinise the speed of the file system. Next will be a close look at the graphical powers, and finally our last test will be a direct test of the overall performance of each PDA.
Just a last note before we do begin: the software used for measuring our test results is, as always, Spb’s software application Benchmark. This program actually has a fifth test mode that involves systems applications that may be preinstalled in the ROM area on Windows Mobile handhelds. Due to the fact that not all devices use this ROM area in the same manner, we have always avoided including this test as we feel it would only give rise to unfair comparisons that may negatively impact on a devices true performance.
The lights are green and we have an immediate surprise at the first corner: the HP 2490, which has always been in pole in all of our last CPU races, holding off a long series of attacks from the chasing pack, finally finds itself losing a few places! Taking the lead, thanks to its powerful Intel/Marvell PXA270 processor, capable of delivering 624Mhz, is the HTC Advantage! A very promising debut indeed for the all-in-one handheld from High Tech Computer, officially presented to the public at the last 3GSM World Congress in Barcellona.
{loadposition gnam}
The test results we show are intentioned to demonstrate the capabilities of each individual CPU, without the extra power that may, in some cases, be obtained from accompanying hardware components. However, we do realise that sometimes the final results may very well be marginally influenced in those devices with dedicated graphical processors (GPU units) or by background process that may be generated by the system and are beyond our control.
– SoloPDA Special – page 3
The Ultimate Benchmark Challenge:
30 Windows Mobile 5.0 PDAs compared.
In truth, we consider the file system speed test to be even more important than the CPU test. The operating speed of a handheld is largely determined by the way the hardware operates as a whole, both when running normal common operations, and also when being put through a harder workout which calls on maximum system resources.
The second lap sees a new leader push its way to the front: the Asus A639 showing evident superiority in the way its file system copes with keeping Windows Mobile 5.0 running smoothly along. Athena, however, manages to keep the rest of the chasing pack behind in its wake, but only by a small margin! Hot on its heels we find the Fujitsu Siemens C550, with its 520Mhz cylinder engine, and the new Glofish team from E-TEN formed by the M700 and the X500! Both these machines come with the Samsung SC2442 motor, in theory equipped with only 400Mhz of power, but obviously fine-tuned by expert engineers to get the most from the unit.
{loadposition gnam}
The file system test performed by SPB Benchmark simulates the handling of images and office documents, in this manner aiming to give a general impression regarding the time needed to launch a program, browse folders and their files, as well as copy and paste files from one folder to another. It’s interesting to note how last place is held by the HP hx4700, especially considering that it’s built with the same engine as the HTC Advantage: it would appear obvious that the decision to make a pit-stop and upgrade the operating system to Windows Mobile 5.0 was a dubious call. We’re quite certain that the machine would have placed much higher had it kept it’s original starting tyres, branded Windows Mobile 2003 SE.
– SoloPDA Special – page 4
The Ultimate Benchmark Challenge:
30 Windows Mobile 5.0 PDAs compared.
Spb defines the “Graphic Index” as the benchmark designed to probe the multimedia capabilities of each device, most notably the video system. The higher the values, the better the speed and performance.
{loadposition gnam}
The surprises continue to flow fast as a new shake up occurs in the front positions: into first place moves the Dell X51, certainly not new to such a leading position whenever it has the chance to express its video playback qualities. The real attention grabber, however, is actually the Fujitsu Siemens T830: even with the added weight of a cellular radio module, and the minor handicap of a square windscreen not fully compatible with Spb Benchmark, it still leaves many of its rivals in its dust. The only close followers are the two companions from the Asus team: the A636 and the A639.
– SoloPDA Special – page 5
The Ultimate Benchmark Challenge:
30 Windows Mobile 5.0 PDAs compared.
The final test conveys a carefully calculated average of all the tests conducted beforehand. It’s obviously the most representative value, mainly because it combines the overall performance capabilities of every handheld PDA under exam.
After such a lightning and action-packed start, we’ve reached the final run to the flag. The bookmakers had tipped him as the w inner, and in fact the first across the line is indeed the Asus A639: the gap opened up during those crucial ‘file-system’ laps proved too big for the followers. Those that had gambled on a good placing for the Glofish pair, made up of the E-Ten M700 and X500, will be happy to reap their takings following a publicly acclaimed podium finish for this new team: standing ovations to Glofish for effortlessly claiming second and third place! Only one machine came close to attempting an overtaking pass on the final straight, and that was the HTC Advantage X7500, which came home in fourth place. Still a very commendable effort from a device that carries a distinct weight disadvantage with its VGA display and cellular radio module – even the most powerful engine would be understandably slowed down with those onboard additions ( as anyone who has driven a Qtek 9000 or i-mate JASJAR will openly admit).
A special mention from the press and field experts goes to the Mio P550: young and seemingly inexperienced, this particular machine showed no signs of being overwhelmed by those considered favourites before the race.
{loadposition gnam}
As stated at the beginning of this comparative test between 30 different handheld PDAs (all running Windows Mobile 5.0), our main desire was to inspire a wave of comments regarding the progress made on the Windows Mobile platform. One result is strikingly clear from these tests however: the newer devices are consistently to be found in the higher places of the table. The reason probably lies in the fact that the components used are of a constantly improving quality, alongside the fact that these new hardware components offer increased compatibility with the Operating System.
Also evident is that the performance difference between PDA-Phones and normal PDAs without an internal cellular radio, once in complete favour of the latter, has not only decreased but apparently actually seen a reversal in tendency. Of course, first place lies safely in the hands of the Asus A639, but we’ve often underlined how this is a handheld that separates itself from the crowd with absolutely above average performance (probably due to the wonderfully successfully implementation of NAND flash memory). However, proving our point regarding the increased ability of PDA-Phones, we actually find three ‘all-in-one’ devices in second, third and fourth positions.
The market won’t stand still and it won’t be long until new handhelds with Windows Mobile 6.0 will be unleashed (and at the same time, perhaps more devices will benefit from upgrade to Windows Mobile 5.0). Our future reviews and tests will keep on trying to determine the rate of progress on the Windows Mobile platform, and we’ll be eager to see just how much of an improvement Windows Mobile 6.0 will bring in the ongoing convergence between features, power and versatility.
As always, our thanks and gratitude towards the companies that provided us with the PDAs discussed in this review. Special acknowledgment also goes to ‘Arkansis’ and ‘davirock’, two of our Forum Community members, for their precious help and assistance.
Autore
- Collegate:
- 750v
- 9100
- A201
- A632
- A636
- A701
- c550
- hx2490
- hx4700
- jasjam
- JASJAR
- K-Jam
- M700
- n311
- n520
- n560
- p3300
- p3600
- p4350
- P550
- Qtek 9000
- rx1950
- s200
- t830
- tytn
- x500
- X51
- X51V
- X7500
