What Will The Future Desktop Interface Look Like? 339
b O b 1 9 19 A writes "The TechZone has an interesting article wondering where computer interfaces are going. They discuss some alternatives to the traditional desktop, and propose a framework in which future interface designs may be evaluated. From the article: 'The next 10 years will be a transitional phase for interface design. 3D rendering technologies already have a stable home in the entertainment, video game, simulation, and design sectors. Although 2D interfaces have dominated everything else, I expect we will start seeing more 3D incursions. Operating systems and applications are beginning to capitalize on what 3D has to offer. The precise nature of how and where 3D can best be incorporated is an open question, and a framework to evaluate these questions seems appropriate.'" Big-time ad alert. Set your ad and flashblockers to stun.
Whatever works best with the... (Score:5, Interesting)
Re:Whatever works best with the... (Score:5, Insightful)
Assuming we get something with positioning in all the dimensions of space (or at least, more than two degrees of freedom of mice) then you can start having interfaces which utilize those spaces.
Of course, right now we navigate 3d spaces in video games fairly effectively, but it's a full-concentration task, using both hands. Which is not exactly ideal for something you multitask in, perhaps? As well as containing the restrictions of a physical 3d world such as gravity etc. Perhaps descent would be a better model.
Just my thoughts off the cuff
Absolutely, positively the wrong metaphor. (Score:5, Insightful)
3D? Okay, visualize trying to find a real piece of paper in a box in a 20,000 SQFT warehourse. Now, if you want to wander around a virtual 3D space doing the same thing like a rat in a maze looking for the cheese, feel free.
So, to my mind, 3D organizational spaces are the wrong direction. Spotlight and Google Desktop are the first steps in the right direction. Why should I have to organize my work and documents into trees of folders and project hierarchies? Why add keywords when the computer should understand context? Shouldn't the computer be able to do that kind of scut work?
Picture the perfect assistant. "Donna, find that claims letter I sent to Bob last week... no... no... yeah that one. Scroll down... down... okay. It's approved. Attach the current spreadsheet and forward it to Dave. Oh, and let me know if he has any changes."
Now, picture "Donna" as your automated, computerized, super-assistant, with whom you can communicate by voice from anywhere, anytime.
Live with a program like Spotlight for a while, and you start to find yourself bypassing the Finder and Desktop and folders altogether. What's needed is a better way to communicate (voice), and a system smart enough to know who Bob is, who Dave is, what a claims letter is, understands "last week" as a variable period, and can put it all together.
Yeah, it's the Star Trek interface.
Re:Absolutely, positively the wrong metaphor. (Score:3, Interesting)
Re:Absolutely, positively the wrong metaphor. (Score:4, Interesting)
Re:Absolutely, positively the wrong metaphor. (Score:3, Interesting)
Okay, we can say that what we need is something that *fast* in usage. There are only a few "interfaces" of you body that are on a thing you could call the "fast lane" we humans have in our brains. These are mainly the hands and the speech system (mouth and throat muscles).
So those two interfaces make sense, but using speech only makes sense if you use all informations avaliable, meaning mood/emotions and the subtile "mea
Re:Whatever works best with the... (Score:5, Insightful)
But, with a computer operating environement, I simply don't see the attraction. The environment of a computer is not in the business of being immersive, or distracting you from reality. It is in the business of making information available to you as quickly and accurately as possible. This goal does not particularly lend itself to 3D - as long as we have had langauge, it has always been expressed in 2D, whether it be carved or painted on walls of caves, chiseled into stone, brushed onto papyrus, or printed on newsprint. Even now, as I type this, I do so onto a 2D digital "paper" that is my LCD monitor. Would 3D lend any additional utility? I can't think of any.
I attended JavaOne last May and went to a session on Looking Glass, Sun's 3D desktop environment. As much as it was attractive, it didn't really add a whole lot to everyday tasks. Sure, they could represent a filesystem in 3D, but it wasn't really any more efficient than midnight commander. You can "fold" away windows to the side of the display, rotating them back into the monitor to get them "out of the way", but it essentially boils down to window shading, only horizontally, rather than vertically.
Of course, there are exceptions. Sun demonstrated a music program where you could add instruments to a song as tracks, and control their volume and balance by moving them in 3D in relation to your real life speakers. To make something softer, you could move it further "into" the monitor. To make it only audible on the left speaker, you could move it to the left side of the screen. Quite novel, but certainly not an application that necessitates a 3D "desktop" environment. It could just as well be run as a standalone program in Windows, Linux, or Mac as they are today.
So while I agree that if we were to have a 3D desktop, it would be nice to have a 3D input device, neither seem to add much utility. Personally, I'm stunned that the multi-desktop (virtual desktop) navigation system hasn't made more inroads. I'm addicted to it in KDE, and Windows' powertool feels like a cheap hack by comparison. I'm stunned that neither Windows nor Mac come with it by default. Mac uses Expose, which strikes me as a complex work around to achieve a similar effect. In the future, I think we'll use other subtle advancements like virtual desktops to extend the functionaility of the user interface in ways that allow us to *organize* the information as we access and use it, rather than displaying it in some drastically different way, like a 3D desktop.
Re:Whatever works best with the... (Score:2)
Whatever works best with Duke Nukem (Score:2)
http://www.3drealms.com/duke4/ [3drealms.com]
Re:Whatever works best with the... (Score:5, Funny)
Re:Whatever works best with the... (Score:5, Funny)
Of all the smilies to use...
Re:Whatever works best with the... (Score:2, Funny)
Re:Whatever works best with the... (Score:2)
Of course, then again, that also means that AOL, Microsoft, and Amazon really will be all that. And Sony will have the perfect DRM. PLEASE KEEP ALL THOUGHTS AWAY FROM THE COMPUTER. YOU ARE TOO PENSIVE NEAR THE COMPU
Re:Whatever works best with the... (Score:3, Interesting)
Helmets with surround sound and surround video will probably get popular a
4D (Score:3, Funny)
But in all seriousness, I am working on the 4D metaphor. I have a prototype I've been working on up on my website, just haven't had the time to finish it.
Cheers
Re:4D (Score:3, Insightful)
"OH SHIT, I can't access outlook, I've got to go back in time!"
But seriously though - look a few posts down - the person found some serious gripes with a 3d interface. Here are mine:
Ok, a 2d interface is immediately intuitive. 2D screen, 2D Mousepad, 2D interface. Simple. But with a 3+D interface, we lose intuitive-ness (and therefore efficiency) in the name of a more advanced system. Some people navigate quite well in 3D, sure, but try handing a copy of blender (or an
Re:4D (Score:3, Interesting)
Re:4D (Score:2)
And no, it's not a completely new interface, but I think it would also be familiar enough that people wouldn't be too confused by it.
Re:4D (Score:2)
I think that viewing the filesystem as well as all the files connection to each other (symlinks,library dependency etc.) would be a genuinly useful thing to have penguin.
There is also some website that has a 3d view with lined connections between articles on their website, but for the life of me I can't remember what website it was penguin. If anyone can remember and point it out I would be grateful penguin!
Re:4D (Score:2, Insightful)
the problem is, as you pointed out, that for most people their main means of navigation around a graphical interface is with their mouse on a two-dimensional surface. this translation of 2D movement to 3D interface is what can be counter-intuitive, not the hypothetical 3D interface itself.
let me put it to you this way, we navigate constantly in the rea
Re:4D (Score:2)
OTOH your project shold be damned fucking funny. Although from the screen shots I have no inkling of idea how its 4D.
Re:4D (Score:2)
Re:4D (Score:2)
Re:4D (Score:2)
Re:Fuck Everything, We're Doing Five Dimensions (Score:2)
noter to mods: Here's [theonion.com] the original
Hopefully in the future I'll still be able to say (Score:5, Funny)
Re:Hopefully in the future I'll still be able to s (Score:2, Interesting)
Re:Hopefully in the future I'll still be able to s (Score:2)
3D not that useful (Score:5, Insightful)
Current interfaces aren't 2D, they are 2.5D. There is a z-axis, it's just less immediately obvious than the x and y axes. Ever put one window on top of another? Yep, that's depth.
The reason why 3D interfaces aren't really that useful is that you really need a 3D input device to make use of it. But the trouble is, the way our bodies are built, it's very tiring to wave our hands around all day long. At least with a 2.5D interface, our hands are resting on something.
The other problem is that the value 3D provides over 2.5D is very small. What does it actually get us? We can already put things behind and in front of each other. We can already zoom in and out of structures. We can't rotate well - but that's not something that I think stops useful things from happening.
What we need aren't 3D interfaces, what we need are smarter interfaces. Not necessarily natural language processing, but simple stuff that works and is practical. Tab completion in UNIX shells is a good example. Intellisense in IDEs is another. Clippy is rumoured to have actually been useful in the lab, before it was hobbled for desktop computers. Spotlight is making things easier to find.
These are the kinds of interface enhancements that will be of most use, and they can come along piece-by-piece without anybody noticing, without needing new hardware, and without users being forced into a new paradigm.
Re:3D not that useful (Score:2, Interesting)
Males tend to be better at spatial memory, while females tend to be better at verbal and communication skills... the 2D interface has been male-centric up till now. Maybe the next step is to ta
Re:3D not that useful (Score:3, Funny)
This is a good start. [photobucket.com]
Re:3D not that useful (Score:2)
I don't know, I'd say that you need both spacial and word association skills. File->save is spacial and verbal. Maybe it's not English but there are languages that have different word orders. If a recent Science Friday episode is any indicator, there's no biological reason
2.5D... that's it! (Score:2)
An e-book! but FULL size. With REAL e-pages. With true point-and-click interface (stylus) instead of a mouse. Want to switch app? Change pages. With non-volatile memories, you can change the page from your full action game, to your homework.
You could use the tabs to have "virtual books", so one tab is the desktop, another is the PDF file you were reading, and so on.
Close the book, and you'll turn off the PC.
Of course, the book will be JUST a
Re:3D not that useful (Score:3, Informative)
You could probably send true 3D through a direct ne
Re:3D not that useful (Score:2)
seriously, you're reading way too much into that, and no, seeing as our sight comes from three dimensions to two points in 3D space, we do have 3D vision. On a less serious note, your comment reminds me of what happens when you get stuck inside a rock on games.
Re:3D not that useful (Score:2)
No, you are failing to understand the concept. We don't have 3D vision. We have 2D vision with depth cueing (AKA 2.5D). Each eye sees a 2D picture. You cannot see the back of someone's head from the front, you can't see south if you're facing north, and the inside of a soccer ball isn't visible unless you cut it open. You are seeing in 2 dimensions. Havi
Re:3D not that useful (Score:2)
Re:3D not that useful (Score:2)
And to add on to what you're saying, humans tend to digest text and documents faster on a 2D surfaces.
That being said, there are many current and potential applications for 3D interfaces. They're quite useful for medicine and CT threat detection.
2.5 D? (Score:2)
Yeah, I understand what it means in this context, and I don't fault the parent poster for using it. . . but, at some level it just doesn't make sense. Not sure what a better description would be, though. Perhaps "tiered 2D" or something of the sort?
Ultimately, the usual windowed computer screen allows the user to make use of a third dimension in almost exactly the same way that a desk with books and papers on it does. The user stacks things up in piles separated in th
Re:2.5 D? (Score:2)
2D with depth cueing. We actually see in 2D, and our brains use analysis of the differential between the two offset images to estimate depth variations. It's more than flat 2D vision, but it's certainly not full 3D (which
Re:3D not that useful (Score:3, Interesting)
You don't wave your hands around all day ?? You obviously ain't from New Yawk.
Everyone around here talks with their hands!
Ya gotta be an idiot not to understand that hand gestures and facial expressions convey a lot of information.
A while back...was it yesterday??
No.. no.. no.. further back
You know what I think looks cool? (Score:5, Interesting)
cool? (Score:2)
Re:cool? (Score:3, Informative)
About Croquet [opencroquet.org]
Screenshots [opencroquet.org]
Many ideas (Score:4, Insightful)
However, it's getting pretty clear that the WIMP stuff we have really is pretty good. We hit upon something which while far from perfect still is reasonable. Other interface ideas need to be substantially better, and without serious flaws, and that is difficult to achieve.
Having a 3D component is a good example. There is little doubt that it will be used in _some_ form at some point in the future. It is also clear that getting it really right is not easy; so many projects have tried and failed already. When what we have is already pretty good, the bar is very high for mistakes, drawbacks and problems.
To connect back with some earlier desktop discussions recently, this is exactly why having a multitude of desktops is a good idea - not just two, but ten or more projects, all trying various ideas and directions. Chances are one of them at least will stumble upon a new, better way of doing something; a new, better way that the others then are free to copy and improve on. That is also why it is so important to have more than one toolkit - ultimately you are constrained to what the toolkit allows you to do, and thus you need more than one to take into different directions.
3D Desktop (Score:2, Interesting)
2D controls aren't just for desktops (Score:2)
I suppose the impo
Advantages Of 3D (Score:2, Insightful)
Re:Advantages Of 3D (Score:2, Insightful)
Re:Advantages Of 3D (Score:2)
Actual quote: (Score:2)
With journalism like that, I can't wait to read what novel and uniquely interesting insights he'll have
Complete Article Summary (if slashdotted) (Score:5, Funny)
[ A d
[ Ad ] A [ a d s
[ AD ] r [slashdot.org]
[ Ad ] t i c l [ A ]
[ AD ] e [ AD ][ D ]
[ Ad ] T e x t [slashdot.org]
[ AD ] 1,2,3,4,5 [slashdot.org]
[ A D mediaplex.net ][ AD ]
PS. My eyes have stopped hurting now.
And while we're at it... (Score:2, Insightful)
I've seen far too many of these articles about how much better 3D interfaces are going to be, and no actual explanation of how it will make my work easier. Which is not surprising, because it won't. It's a solution in search of a problem.
Here's was I think would be useful (Score:3, Interesting)
I think anything that allows people to really use their computer the way they want would be great. I'm not saying it doesn't already exist, but I mean something where nearly everyone becomes accustomed to using a computer as a configurable tool. Something where all those times people say, "Well, I just want it to do [this]!!", they can easily set it up to do whatever it is.
Just my thoughts.
Bingo (Score:2)
Re:Bingo (Score:2)
No - because you're still thinking like a computer programmer and not like a computer user. The concept of modular code is totally foreign to the average user. The silver bullet as far as "programming by the masses" is natural language processing and universal data abstraction. Of course, that's a long way off - but if we can ever get a system that understands not just what I'm saying - but what I really MEAN (incorporating context that I don't even directly communic
Re:Bingo (Score:3, Insightful)
No, the silver bullet are related to direct manipulation [wikipedia.org] (removing abstraction and simplifying input) and programming by example [mit.edu] (again removing abstraction, and simplifying depuration). I should know, I'm a res
Re:Here's was I think would be useful (Score:3, Interesting)
That's where 3D might be able to help, by representing programs, their inputs and their outputs with 3D models that could be put together like say... K'Nex. There would only be X types of models, where X is the number of ways a given program can connect to another, but if they were actually color-coded (like the previously mentioned toys) it would become rather easy to pu
Re:Here's was I think would be useful (Score:2)
*cough*OpenDoc*cough*
Re:Here's was I think would be useful (Score:2)
People! (Score:2, Funny)
Not KILL
It'll be the same as now...mostly (Score:2, Insightful)
Where are we now with Windows and Mac OS? Just refinements of what works or doesn't work from 10 years ago. In 2015 we'll be having the same articles and little will have changed.
Re:It'll be the same as now...mostly (Score:2)
The Mac OS has changed drastically since 10 years ago. Except for the menus being on top, the desktop icons being on the right, and the resize corner being in the lower right, the Mac OS interface of today looks completely different than the Mac OS of 10 years ago.
Within just the past few years, Apple has integrated Dashboard, integrated column browsing from NeXTSTEP, created the dock and improved its functionality, and don't forget Exposé, which is, i
Re: (Score:2)
Re: (Score:2)
like a desktop (Score:5, Interesting)
People just don't work that way though (Score:5, Insightful)
You know what I'd really like? The same interface I have now, on a 30" LCD that costs $1000. Hell, make that three of them. I'm using three 17" LCDs right now and two notebook computers next to me. What does joe sixpack want bad? a 60" plasma TV.
That I suspect is what the future will bring.
You want my predictions for 10 years?
Great big, high resolution displays, and probably several of them.
A wireless keyboard sitting in front of that display.
A wireless mouse sitting right next to it.
Next to that monster display will be a pad of engineering paper, and a pencil.
A big plasma TV on the wall, perhaps displaying video conferencing.
No guarantees on where the computer is - probably nowhere to be seen.
Perhaps a PDA or remote storage device capable of wireless networking.
That's the future. What's on the screen will probably look very much like what is there now.
Re:People just don't work that way though (Score:2)
Re:People just don't work that way though (Score:3, Insightful)
Do you know why you sit in front of your computer? Because you have to.
If you could take your computer with you, say, to the restroom, wouldn't you? (yes, if you're a laptop user with wifi, chances are you've already been there.)
The trend is toward less wires and more motion. PDAs are an awkward interface for a real need.
Given a choice, people will want to check slashdot while they're walking down the street, or talking to that boring co-worker.
I agree people will want more
Re:like a desktop (Score:2)
Currently, I've heard that virtual reality goggles provides motion sickness: you're head is moving but what you're seeing is not moving --> motion sickness.
I don't know about you, but I'd hate getting seasick with using a computer.
So to work, as you said the computer must monitor the head and do it nearly flawlessly before the setup is usable, somehow I don't expect this kind of setup being used.. especially not in 10 years!
IMHO before swit
Huh? (Score:2)
The same is true of planes in three dimensione, or cubes (or maybe whatever you'd call an infinite version) in four dimensions.
Re:Huh? (Score:2)
How can you be so insensitive!. Do you want your lines to be uncomfortably crammed up?
Please someone think of the lines!
Smarter Features (Score:2)
Re:Smarter Features (Score:2)
Also, I'm not sure I'd want my computer reading my mind. I've got enough porn as is, thank you very much.
Re:Smarter Features (Score:2)
I hate the way that function is implemented on telephones and intensely dislike the talking paperclip that also attempts to solve that problem. With a very general purpose device that would be hard to implement well without very carefully identifying the context in software.
The other option is having an user interface to the application that requires very little input - but usually
PC interface? (Score:2)
One Big gOK button. (Score:2)
Very usable, does nothing, Everyone understands it. Developers consider themselves visionary looking at 0 bugs filed.
The tasks performed on a computer. (Score:5, Insightful)
I introduce first to you the humble progress bar. A good progress bar does two things. It shows how far along something is (percentage complete) and it show that activity is taking place and your computer has not just frozen again.
So in days past when screen were primitive you simply had a row of dots appearing with maybe if your lucky the occasional 5% added to give something like ......5%........10%....
Add the capabilty for backspace and you usually got a little spinning character made up out of -\|/ to show action taking place. Some more advancement and you got a full bar like 0****5****10****15..| (work with me here this is hard to do in text)
But then GRAPHICS were added. YEAH. So now you could draw a bar slowly being filled (but for some reason loosing the activity indicator). Color was added and now you could make the bar turn from red to green.
2.5d add shadow effect to make the bar appear round. 3d and it can stand up like a real seperate bar on your screen.
And what is the freaking point? Well none. All of them did their work and clearly showed what was happening. Okay they became better looking but it gave no real advantage.
So are there other tasks that can benefit from better graphics? I think you have the following main type of jobs on a pc.
Yes I would like a 3d interface when I am manipulating or inspecting the relations between objects on my pc. But is this a common activity? Well I look up at the tabs of my opera browser. Current desktops already have a sort of 2.5d and perhaps my tabs would be clearer if tabs of new pages where "behind" the tabs they originated from. I arrived at this input screen by opening a new tab from the story page (helps me remember where I was when I am finished here) but this tab is at the end of the tabs not indicating that it has a relation with a tab almost at the beginning.
Still with me? Another example. My music collection has a lot of soundtracks. Trying to organize it completly is a nightmare. Especially if I also want to organize it by genre (so I can easily switch depending on mood). Luckily I am on linux so I can use symlinks so an album can be both in
Re:The tasks performed on a computer. (Score:2)
Our brain is quite good at reconstructing 3D-ness for the simple objects that surround us, but I'm not so sure that it'd be able to do a good job for complex 3D diagrams.
So 3D would help, but how much? That is the question.
For the tab, you can already do some kind of organisation in 2D, for example you can open different w
Easier to deal with 3D representations in 2D (Score:2)
Everyone already knows... (Score:2, Insightful)
Preview screenshots of Vista beta are circulating here:1 3.html [unitedti.org]
http://www.unitedti.org/lofiversion/index.php/t41
That's right. (Score:2)
You're right. It will be Windows Vista. Windows has 90%+ of the market now, and Vista will be released in about ten years. Therefore Windows Vista will be the operating system of the future!
Sounds like the cop.rev. all over again.... (Score:2)
Historical Inertia (Score:2, Insightful)
The most obvious example I can think of is writing. Using syllabaries or ideograms is clearly not as good a technology as using an alphabet. The learning curve is vastly worse, the total number of symbols that must be memorized is orders of magnitude higher, etc., etc.
And yet a pretty high percentage of people in the world today read and write in languages that do not use
Re: (Score:2)
A Navigatable Distributed 3D Desktop (Score:2)
Think of a hallway with various doors along the way. Behind each door would be a person's desktop. Navigate down the hallways to a person's "office", enter the door, if permitted, and enter a public version of his desktop. Through an internal door would be the private
What will it look like?? (Score:2)
3D is old-hat. Think 4D. (Score:2)
However, it is highly inefficient to modify data in a purely serial manner. Serial went out with punch tape. You
I like the Xenosaga One (Score:3, Interesting)
interesting thought... (Score:2)
The future is not now (Score:2)
Two words (Score:2)
The Brain (Score:2)
That said, I doubt anything will come of any new approaches for years to come. We still have offices, and in those offices we'll work at desks to generate paper which we'll put into labelled fold
Cargo Cults (Score:2)
In 10 years? Maybe a lot like today. (Score:3, Interesting)
What I expect in 10 years, if the past 10 years are any indication of the speed of desktop evolution:
* Better displays on average. Big, crisp, bright, high resolution, high contrast, and especially wider.
* Similar UI elements as today, plus a few new ones. People don't like change if it involves taking something away.
* Faster response. Programs will load almost instantly. Maybe they'll just load when you install them, and be swapped out to non-volatile ram when not in use. Though 10 years ago I might have predicted we'd have this by now.
* Resolution independence. Quality aside, programs will look the same no matter what your screen resolution, and you can smoothly scale them to any size. I'm tempted to say we'll have a lot more vector graphics, but a lot of lazy designers will probably just use high resolution rasters.
* Mouseover/mouseout background window preview, maybe by alpha blending. If I move the mouse to a background window, I want it to somewhat show through the windows in front of it. Also, if I move the mouse away from a foreground window, I want to slightly see the windows behind it. I'm not 100% certain this'll look good though.
* If I'm lucky, maybe we'll have a mouse button mapped to opening a system menu whereever your mouse might be on the screen, centered under your mouse. This menu will be multi-column, approximately square shaped to reduce mouse movement and make effective use of space. Holding this button down while turning the mouse wheel will ideally cycle through my virtual desktops, rather than popping up a menu.
* Touchscreens may become standard, but many will still prefer mice for precision. I hope to see the ability to track multiple fingers/pointers dragging across the display.
* Better autocomplete in many programs. Tab should become my favorite key. Voice will not replace the keyboard, but only complement it. You can take my keyboard away after you pry it from my cold, dead hands. When I speak into a computer microphone, it'll probably usually be to communicate with real people.
* Better use of usage statistics. The desktop environment and programs will adapt so that most common actions require 1 click to initiate.
Prediction (Score:2)
The revolution will happen when HCI stops measuring efficiency as "time to complete task" and "task completion %".
Discuss.
Asymptote? (Score:5, Interesting)
Re:Advertisments.... (Score:2)
Indeed. Imagine the wonderful advertising that will be possible with those new user interfaces. 3-D ads! Spyware that reads your mind -- maybe not perfectly, but well enough to target ads at you (certain agencies already do functional MRI scans on focus groups... too lazy to find the link).
OTOH, the ads will be the first people to show us how to write useful web apps in neural-AJAX.
Maybe I'm kidding.
Re:What a crock! (Score:2)
1. More bloaty software, larger filesizes (you thought 2D was bad, 4D is like that, but squared!)
2. Longer dev time.
3.Slower running software with higher requirements.
4.Obviously a huge project that took forever to complete, requires a dedicated hard drive, and runs twice as slow as Doom 3 on top of the line hardware is an amazing new technology that all the kewl people have and if you don't you're lame.
Re:The Star Trek way... (Score:2)