Wednesday, January 19 2011

Some wager that the upcoming iPad 2 will pixel double both axis, similar to what the iPhone 4 did relative to its predecessor, while others believe that it will keep the resolution of the current generation.

Doubling both axis is a formidable technical challenge and would be a unique, likely expensive display. Continuing with the current resolution would represent a significant competitive disadvantage. As people acclimate to high density smartphones, such as the iPhone 4, the iPad's low density is really starting to stand out.

Few believe it will do anything in between. It won’t, the common wisdom goes, go to say 1536 x 1152 or 1280 x 860, or any other fractional improvement less than an outright doubling or quadrupling. The logic is that pixel scaling issues eliminate the possibility of such a half measure.

This harkens to discussions that occurred over 20 years ago.

It should be an embarrassment that such a discussion is occurring in 2011.

In the TiPb article linked above the author leads off with a slur towards Android, saying “Either iPad 2 will have a standard 1024×768 display or a doubled 2048×1538 Retina Display, or developers and users will be in for the type of frustration usually ascribed to Android.

That makes for an odd, if not outright ignorant, statement: I can’t recall ever reading anyone complain about the density independent pixel of Android, or its awareness and accommodation of a wide variety of profiles. That’s a problem that it has solved very well, and a large ecosystem of sizes and resolutions of displays exist in remarkable harmony.

Consumers like being able to choose between 3” – 15”+ devices with a wide variety of densities. Choice is good.

Because of course the DPI issue has long been solved. Otherwise you would be lamenting that your 72dpi word processor isn’t compatible with your 300dpi printer: “Everything prints out all tiny-like”. Is that the case?

Vector fonts with pixel independent abstractions have been around for a long time (in TrueType and Postscript form), with Apple as one of the primary inventors. Most GUI frameworks, including iOS, have the ability to scale UI rudiments to virtually any resolution and pixel density with ease.

That is an ancient problem, long solved.

But what about icons? What about bitmap graphic artifacts?

In an ideal world icons would come in vector graphic form. That isn’t the case on Android (the platform doesn’t support SVG, including in the browser, which is a huge deficiency), but it is still shocking that Apple, which usually takes the lead on such innovations, doesn’t use them for iOS, as had been widely speculated as a given before the iPhone OS was first released.

With a vector graphic the rendered image is always perfect for the target, ideally with hints that suppress decorations at very low sizes.

Even with bitmap graphics, however, while it’s easy to contrive ridiculous examples to demonstrate the worst of scaling, the reality is that given that text should always be UI generated from vector fonts, perfect for the target, and graphics are usually just supplementary decorations, where scaling up or down by partial multiples is often perfectly adequate.

For your consideration below are some iOS icons (used for fair use purposes but owned by Apple) at their original pixel size, and then scaled to 125% and 150%. Scaling was done using Sinc (Lanczos3), which is a good algorithm to use when scaling up and you want to maintain fine detail.

iPad original icons

iPad icons @ 125%

iPad icons @ 150%

The horrors! Just to be clear (as it's hard to imagine what the larger images would look like when shown in the same physical space), we're comparing this to simply pixel-doubling, which would look like the following (cropped to avoid exceeding most reader's screen bounds).

icons at 200%

There is no universe where a straight pixel-doubled image looks better than an interpolated image, unless you have fine detail in the image (like text) which shouldn't be in the image to begin with.

Not only do they still look great, but remember that in such a case the actual viewed sizes would also decrease proportionally, so the marginal artifacts would be rendered completely irrelevant. Reading some of the blog entries on scaling you would think you’d end up with some sort of blob.

Not to mention that most iPad apps would be fixed up to handle the new platform shortly after the SDK were released.

I find it incredibly hard to believe that Apple will maintain the same resolution. The device was already considered under-pixeled when first released, and has succeeded despite that deficiency. With the appearance of actual competition over the coming months it would put the successor at a serious disadvantage out of the gate. Apple has always emphasized and often led in the spec department (the thinnest, lightest, brightest screen, widest viewing angle, highest pixel density, etc), so I don’t believe that Apple would allow such a scenario.

At the same time, doubling the pixels is a big expense because such a panel doesn’t yet exist, and that sort of density is rare in larger displays.

Then again, Apple, in talking about their blockbuster quarter yesterday, spoke about a mysterious $3.9 billion dollar supply chain investment. It would not surprise me in the least if they managed to get the volumes and process in place for such a display given how critical the iPad has become to their bottom line, and Apple's tendency to set new benchmarks.

If I had to place a wager, however, I would bet that Apple neither keeps their current resolution, nor will they double the resolution. I would guess that they will go to 1536 x 1152, or more likely 1280 x 960.

 iPad  Android  iphone 
   

Reader Comments

If those large images still look great to you, you need to see an eye doctor... just saying
Eber @ 1/19/2011 1:59:05 PM
I can't force a square in your monitor to have twice the DPI, however I feel quite confident that the first image on an N dpi monitor will look imperceptibly different from the third image on an 1.5N dpi monitor.

I would go further and say that the 1.5N dpi version would look better than a simple pixel doubled 2N dpi version.
Dennis Forbes @ 1/19/2011 4:13:54 PM
http://apenwarr.ca/log/?m=201101#19

Interesting article. Author says-

"If you watched the Android vs. iPhone debate over the last couple of years, you saw a series of Android phones with successively higher DPI in the same physical area, followed by the iPhone 4, which had a just slightly higher DPI than the most recent Android phone at the time, but which happened to be double the resolution of the original iPhone, because the iPhone hadn't been trying to keep up."

This is humorous because when the 3GS was released, QVGA was what everyone was using. Until the Nexus One, released at the beginning of 2010, it was the standard, but the N1 started the higher resolution releases. When Apple released their next device they had to not only "keep up", they had to blow it away. I really don't get the sort of revisionist history when it comes to Apple.

"Holding off until you could get an integer 2x multiplier, however, was frickin' genius."

Apple was doing their next yearly release. They weren't "holding off" on anything. They had to outclass the competition, and they did. The doubling was simple laziness to make up for catastrophic short sightedness in the platform.
Dennis Forbes @ 1/19/2011 4:36:26 PM
Dennis, the flaw in your latest comment is that it was 99% likely that Apple was testing the higher-res display for the iPhone4 18-24 months before it actually made it into the shipping product. Unlike the other manufacturers, I would say they actually have the resources to do their own display tech R&D and just held off shipping until the time was right. Hardly " simple laziness to make up for catastrophic short sightedness".

Likewise with the iPad, who is clamouring for a Retina display there. It's the geeks. I'd be confident Apple will just hold off with the "old" tech until the time is right for the double-res. In other words - they do don't stop-gap measures.
Josh M @ 1/19/2011 11:58:14 PM
"Unlike the other manufacturers."

Apple doesn't manufacture displays. They don't have display R&D. I highly doubt that Apple was even aware if such a display was possible until 6 months or so before the iPhone 4's release.

There is a religious mythology about Apple that is hard to comprehend, and impossible to debate against. Apple is not all knowing, all capable. It's a company drawing from the same supply chain as everyone else.
Dennis Forbes @ 1/20/2011 6:24:22 AM
Sorry, first I agree with Eber: this upscaling is really not matching the quality standards of today. Second, there definitly are issues with android when it comes to support different display types. We bought an Samsung Galaxy Tab as test device and are now in need to buy "standard" android phones because the differences are too big.

Think of an webview (scaled 100%) loading an website with fixed width; the webview should scale its content to 100%...
Markus Greve @ 1/21/2011 6:24:18 AM
Apart from the fact that 9.7" displays at double the iPad's resolution aren't on the market today -the technology is there though, it's just a matter of production cleanlyness now- there is also the fact that mobile graphics chips at the moment aren't really equipped to drive such a large resolution with any sane framerate.

I mean, none of my desktops can drive such a display, if only for the fact that their output ports don't have the bandwidth.

That would be the major problem for iPad pixel doubling.
Henk Poley @ 2/18/2011 3:41:59 AM
Author, you made an error. You mentioned resolutions of 1536 x 1152 and 1280 x 860. Neither would have the same 4:3 scale of the current iPad.

The two better alternative resolutions would be...

1280x960 would be ideal. This is exactly a 1.25x scale increase over the current resolution. This allows playback of 720p (1280x720) movies downloaded from iTunes without downscaling.

And this is exactly twice the iPhone 4's resolution (640x960) so you could allow people to have two iphone apps open side by side, simultanously, and multitask, with no loss of resolution. People can read email while browsing online etc.

If you use interpolation, current apps will look fantastic when upscaled by 1.25x.

1920x1440 also works well. It's also 4:3 just like the current iPad. Would allow for 1080p playback without downscaling. :)
Please fix this error in your article. @ 3/19/2011 3:00:47 PM

Add Comment

Name *:

Email Address:

(your email address is not displayed)
Website:

Comment *:



About the Author
Dennis Forbes Dennis Forbes is a Toronto-based software architect. While focused primarily on the .NET and SQL Server worlds, Dennis frequently ventures outside of this comfort zone into game development and image processing. He has been published in several industry magazines, has been quoted in the Wall Street Journal and has been interviewed by NPR.

He is a vice president and lead software architect at an innovative New York City hedge fund back-office services firm.

Dennis has been working on solutions for the financial, telecommunications, and power generation markets for over 15 years.





 

Dennis Forbes