I also thought about, but never implemented some sort of lighted display, possibly a dollar sign that slowly turned from red to green as an indicator of the days profit from sales on my e-commerce channels.
Similar issue with the newer laptops that include power buttons as part of the keyboard. The power button no longer has a noticeable change when pressed, and if the laptop is fanless or just very quiet, it can be impossible to tell if the damn thing is turned on or not.
Sometimes I wonder if the manufacturers are doing this on purpose, to make the customer feel more distant from their devices and willing to part with them easier.
Humans constantly monitor their environment, and tend to only become conscious of something when it is behaving differently than it had been. Think of long drives - unexpected motions, odd noises, etc. trigger conscious attention.
Computers, especially of the 'cloud' variety, lack the incidental physical environmental interactions that give us those, so intentionally building them in is required. (And because they're intentional and artificial, they're at risk of manipulation, something else to worry about.)
I've thought of "reimplementing" that for troubleshooting my own projects. Imagine `clang --sounds`, so that it makes a sounds when
- Accessing disk.
- Sending something on the network.
- Allocating large buffers.
- Waiting for locks.
Or, alternatively, there's a constant background sound that is modulated on every function call depending on
- Call stack depth.
- If it's my code, library, or syscall.
- How long the last call took.
- Or just a unique modulation for each major function.
I think that's a nice, easy, and useful step before the more advanced applications mentioned in TFA.
A professional in _any_ industry will pick up a notable difference between extremely similar states. This article is expressing the fact that older computers were easier to read.
I'm convinced it's a product of sophistication. Distributed systems used to be an enterprise thing, but now everything is technically a distributed system. Memory registers are quantum scales more than they used to be. Drives now have no moving parts.
There are still ways to get an intuitive understanding, but they're...different, and certainly not audible. I've noticed that I can feel out I/O speeds when I'm power-using. I'm fairly convinced that many knowledge workers prefer a specific OS because this intuition pulling up false-positives in a new environment.
This type of "sixth sense" is also not limited to computers. When I worked in the aerospace industry, I heard a story about McDonnell Douglas replacing the F-15 cockpit fairing with a sleeker, fewer-piece version that reduced drag. Pilots found that without the noise from airflow over the metal joints, they didn't have as good a feel for speed and maneuvers.
It didn't work spectacularly well though, and I gave up on the idea.
Earlier with my tape based computer I could tell what program was loading by the sound, and if it had an error.
Computers should have normal auditable log files, board schemes and spare parts. If it works right, it should be invisible. If it stops working, I call plumber who will fix it very cheaply.
This "computers are magic" is just BS. I refuse to "interact" with my thermostat. Soon this 6th sense will feed ads into my subconsciousness.
"Our goal is to enable robots to express their incapability, and to do so in a way that communicates both what they are trying to accomplish and why they are unable to accomplish it... Our user study supports that our approach automatically generates motions expressing incapability that communicate both what and why to end-users, and improve their overall perception of the robot and willingness to collaborate with it in the future."
I'm not as plugged into human-computer interaction work, but as a user, it seems like this is sorely missing and getting worse. I wish I could get a happy medium somewhere between a full stack trace and silent failure, e.g. when my iCloud documents won't sync.
https://mymakerspace.substack.com/p/another-look-at-infrastr...
(Previous HN discussion: https://news.ycombinator.com/item?id=24303832)
I can't tell you how much of a relief it was to have finally have a computer with solid state everything, an insulated case, 120mm fans. Turned it on, silence. It's good for recording sound, it's good for anyone else who happens to be in the room.
Why sound? why not just a.. oh idk. disk access light? Maybe add other little leds for other stuff?
Making the invisible processes of change and exfiltration legible to humans, even only as background noise, would humanize these awful OSes in a big way.
I could tell whether thee machine was crashed, and a lot about what part of a program was running by the texture and tone of the noise.
I've yet to see this mentioned - or demonstrated - anywhere else.
Which reminds me I need to update the case for 8 lights now that the 5700G is available and worth doing an upgrade to the Mellori_itx.
The motor made just a little bit of noise and the string would wiggle around indicating network activity. Soon he was able to know what was typical string movement and what was atypical frenetic motion that indicated a need to investigate.
He called it an "ambient interface" and said he had read about it somewhere.
Meanwhile, I used to have a Surface Pro 3 that did none of those. Pressing the power button did nothing for several seconds, and sometimes I would have to push the power button again after some seconds, for some reason. Quite irritating.
Of course, in a single line household, sometimes you'd catch the line in use, and the speaker would confirm that vs no dialtone error. Ocassionally, you might also get glare --- picking up an incomming call before it rings, and listening in might help recover from that as well.
Speaker on while connected could be useful for monitoring for connection disturbances (and maybe forcing a lower speed on a reconnect) or call waiting beeps, but was usually too low signal to bother. Also, I had a phone that would click/chirp on call waiting even when on hook which was a lot more actionable.
When I get back into the game with Windows again, I'll be seriously looking into ETW, Event Tracing for Windows.
It seems the best startpoint to learn about ETW is https://randomascii.wordpress.com/2015/09/01/xperf-basics-re... and https://randomascii.wordpress.com/2015/09/24/etw-central/.
The 2nd link above has a bunch of links to other pages, but is a few years old, so while the old info is still relevant, a quick poke around this blog's tags finds the following additional, newer posts that also demonstrate real-world insights of ETW saving the day in a bunch of practical situations:
https://randomascii.wordpress.com/2017/07/09/24-core-cpu-and...
https://randomascii.wordpress.com/2019/10/20/63-cores-blocke...
https://randomascii.wordpress.com/2019/12/08/on2-again-now-i...
https://randomascii.wordpress.com/2021/02/16/arranging-invis...
https://randomascii.wordpress.com/2021/07/25/finding-windows...
https://www.brendangregg.com/blog/2019-12-22/bpf-theremin.ht...
It is fairly trivial to see all of main memory and single step execution of a wasm program. If one runs wasm3 in wasm3, you can then trace the inner interpreter as well. Check out the section on trace visualization.
The website appears to still be available at:
MS Windows could really use a "WHAT THE HELL ARE YOU THINKING ABOUT?" feature. From the first version of Windows with networking, a Windows install had a lifespan of a few years, after which simple things like clicking on the Start menu would take several seconds to respond. You expect this when connecting to an external disk share, but it was woven into the OS so that it happened at weird times.
I didn't know enough about Windows internals at the time to figure out why this was happening. After a few days/weeks/months of irritation, I usually ended up doing a fresh install and re-installing/configuring all of my apps.
Just in the last month or so, my Windows 10 development system will sometimes take several minutes to pop up a File Explorer window. Default File Open/Save dialogs are affected as well. I'm not using any shared drives and I disabled the stupid One Drive thing. At this point, a reboot resolves it, but I sense another reinstall in my future...
It’s really discomfiting when I’m away and lose track of that completely.
You could hear the noise/tone change with various different types of computation, and for some frequencies listen to the framebuffer scanout (I think) where the sound appeared to match the display changes. Definitely not in the UHF range of the actual signal though.
This computer finally made me buy an external audio interface out of frustration. I went on to do some acoustics projects and I really needed cleaner audio for them.
But of course, in general either could be the case. And perhaps don't want to wear earphones (or disturb colleagues) etc. only meant it as an additional similar idea.
Conway's Game of LIFE in a DEC PDP-7 w/ Type 340 Display
https://www.youtube.com/watch?v=hB78NXH77s4&ab_channel=Livin...
Early computer graphics -LIFE - 4 Gosper Glider Guns on a DEC PDP-7 Type 340 display
https://www.youtube.com/watch?v=JhvOw7vW4iA&ab_channel=Livin...
DEC PDP-7 w/ Type 340 display running Munching Squares and Spirograph
https://www.youtube.com/watch?v=V4oRHv-Svwc&ab_channel=Livin...
Also PDP-7 related (but with more melodic music), here's a video remix I made of an early CAD system called PIXIE (with the first known implementation of pie menus, using a light pen) running on a PDP-7 with a type 340 display, networked with a Titan mainframe, at the University of Cambridge (one of the first network distributed graphics systems), set to music:
https://www.youtube.com/watch?v=jDrqR9XssJI&ab_channel=DonHo...
https://en.wikipedia.org/wiki/Calm_technology
>Calm Technology
>History
>The phrase "calm technology" was first published in the article "Designing Calm Technology", written by Mark Weiser and John Seely Brown in 1995.[1] The concept had developed amongst researchers at the Xerox Palo Alto Research Center in addition to the concept of ubiquitous computing.[3]
>Weiser introduced the concept of calm technology by using the example of LiveWire or "Dangling String". It is an eight-foot (2.4 m) string connected to the mounted small electric motor in the ceiling. The motor is connected to a nearby Ethernet cable. When a bit of information flows through that Ethernet cable, it causes a twitch of the motor. The more the information flows, the motor runs faster, thus creating the string to dangle or whirl depending on how much network traffic is. It has aesthetic appeal; it provides a visualization of network traffic but without being obtrusive.[4]
[1] https://web.archive.org/web/20190508225438/https://www.karls...
[3] https://web.archive.org/web/20131214054651/http://ieeexplore...
PDF: http://www.cs.cmu.edu/~./jasonh/courses/ubicomp-sp2007/paper...
[4] https://web.archive.org/web/20110706212255/https://uwspace.u...
PDF: https://web.archive.org/web/20170810073340/https://uwspace.u...
>According to Weiser, LiveWire is primarily an aesthetic object, a work of art, which secondarily allows the user to know network traffic, while expending minimal effort. It assists the user by augmenting an office with information about network traffic. Essentially, it moves traffic information from a computer screen to the ‘real world’, where the user can acquire information from it without looking directly at it.
https://en.wikipedia.org/wiki/Natalie_Jeremijenko#Live_Wire_...
>Natalie Jeremijenko
>Live Wire (Dangling String), 1995
>In 1995,[9] as an artist-in-residence at Xerox PARC in Palo Alto, California under the guidance of Mark Weiser, she created an art installation made up of LED cables that lit up relative to the amount of internet traffic. The work is now seen as one of the first examples of ambient or "calm" technology.[10][11]
[9] https://web.archive.org/web/20110526023949/http://mediaartis...
[10] https://web.archive.org/web/20100701035651/http://iu.berkele...
>Weiser comments on Dangling String: "Created by artist Natalie Jeremijenko, the "Dangling String" is an 8 foot piece of plastic spaghetti that hangs from a small electric motor mounted in the ceiling. The motor is electrically connected to a nearby Ethernet cable, so that each bit of information that goes past causes a tiny twitch of the motor. A very busy network causes a madly whirling string with a characteristic noise; a quiet network causes only a small twitch every few seconds. Placed in an unused corner of a hallway, the long string is visible and audible from many offices without being obtrusive."
[11] https://web.archive.org/web/20120313074738/http://ipv6.com/a...
>Mark Weiser suggested the idea of enormous number of ubiquitous computers embedding into everything in our everyday life so that we use them anytime, anywhere without the knowledge of them. Today, ubiquitous computing is still at an early phase as it requires revolutionary software and hardware technologies.
I've thought about making an app that lets you know what's happening in the background with a black bar that has jets of colour move across it when something happens, with different speed, colour, and shapes based on various attributes, like which app the activity came from, and what type of activity it was.
Also each time it beeped the bell it would start at a higher and higher tone rising to a fixed pitch, each starting higher and lasting less time than the last, so a lot of bells in a row would ramp up in tone and shorten out to a high buzz, so they weren't so annoying. Then it would decay back down after you didn't receive any bells for a few seconds. It was inspired by the way of an excited guinea pig squeals for lettuce.
https://www.youtube.com/watch?v=5jfoxSeJzWo&ab_channel=It%27...
Also, the underline cursor floated up and down and up and down in the character cell, so it was very easy to see where it was, and it drew a wavy line in the phosphor as it moved across the screen!
> -B > > Sound the bell at the start of each (major) garbage collection. > > Oddly enough, people really do use this option! Our pal in Durham (England), Paul Callaghan, writes: “Some people here use it for a variety of purposes—honestly!—e.g., confirmation that the code/machine is doing something, infinite loop detection, gauging cost of recently added code. Certain people can even tell what stage [the program] is in by the beep pattern. But the major use is for annoying others in the same office…”
https://downloads.haskell.org/~ghc/latest/docs/html/users_gu...
Meanwhile, I'm over here with every LED in my apartment that's not tied to an IR reciever taped over with black electrical tape. I don't mind fan noise at all, but the sea of twinkling LEDs that come from modern electronics drives me insane.
You... refuse to feel temperature? I'd wager that more people operate their thermostats based on their ambient reading of how hot/cold the room is rather than a data-forward approach.
From the Usenix (https://www.usenix.org/legacy/publications/library/proceedin...) abstract:
> We created a network monitoring system, Peep, that replaces visual monitoring with a sonic `ecology' of natural sounds, where each kind of sound represents a specific kind of network event. This system combines network state information from multiple data sources, by mixing audio signals into a single audio stream in real time. Using Peep, one can easily detect common network problems such as high load, excessive traffic, and email spam, by comparing sounds being played with those of a normally functioning network.
The SourceForge page is still up: https://sourceforge.net/projects/peep/
If only we had two receptors on the front of our face that were capable of detecting EM radiation with wavelengths between 380nm-700nm.
I do however think that giving tech companies + ad companies the ability to tap into this is risky. As a result, rather than have a call-to-arms to invest more in such tech, maybe it's better to just start the conversation on how we can interact with the digital world safely.
...Or maybe which digital worlds are safe to connect to? :thinking_face:
The funniest thing was seeing how everybody was paying attention to that buzzing at all times. You could have a dozen people talking about different aspects of the experiment, but if that buzzing drops out for a few seconds, every single conversation immediately stops. Usually it would come back after a few seconds and the conversations would resume, but it was fascinating to have visible proof that everybody was ready to drop their current work in order to get the experiment running again if anything happened.
Edit: I also heard tales of somebody who had trained themselves to wake up if the buzzing ever stopped. That way, they could take short naps during the night shift, while still being present and ready to resolve any issues that came up.
I had no idea what this article was going to be about, but determining behavior based on physical characteristics of the hardware is something I miss with modern, quiet machines.
This isn't as aesthetic as say, the LiveWire[2] mention in the comments. But it's readily available on almost all systems, and is a very flexible ambient indicator.
There's a lot of really really fun good stuff in the comments here. Ambient is good, but to me, I want computing that exposes the causal relationships of what is happening as it's processing, as it's running. "This button was clicked so I'm trying to change the screen brightness now." All of the entities of computing, the data, these user events, should be reified, should be made into a logged sequence of what is happening. From that basis, we can all be free to explore computing, and to- EventSourcing style- extend the graph of computing as we might see fit.
[1] https://github.com/torvalds/linux/tree/master/drivers/leds/t...