Join the discussion
Write your take first — we'll ask for email only when you're ready to publish.
- Hacker News
- Humans are so good at pattern recognition it's uncanny. Back in the modem days, most people automatically recognised the most important phases of downloads because of the way they sounded .by toolslive
- I vaguely remember a reverse engineering tool in the mid-to-late 2000s that displayed a similar (albeit greyscale) visualisation of entropy within large binary files. Anyone know what tool that would have been?by swiftcoder
- I was surprised by the timing of this post, after recently shipping a similar tool quite similarly named (vizbin as opposed to binviz). A little more surprised to see that so many folks have also developed similar tooling.
I don't know the name of the tool that did entropy visualization you're remembering, but this was my cue to mention that vizbin does that using the colorizer of your choosing.
https://github.com/scottvr/vizbin/blob/main/docs/GALLERY.md#...
It can also show you a binary diff with colorization (and unlike cmp, an insertion does not make everything after it a "change", which I find useful.) https://github.com/scottvr/vizbin/blob/main/docs/GALLERY.md#...
Another comment mentions using such a tool on source code; the binary strings example shows just that, with the source embedded in a tarball. Text is rendered as an 8x8 glyph font so you can immediately eyeball both.
https://github.com/scottvr/vizbin/blob/main/docs/GALLERY.md#...
Rendering known pure text as 8x8 bitmap fonts via the tool might be a bit ludicrous, but you can force a different byteclass and see only the colors and not the actual ASCII characters, which I think might be what they are getting atwanting to do. https://github.com/scottvr/vizbin/tree/main#profile-structur...
Another useful things falls out from combining these concepts, which is that you could run `vizbin` on an entire repo. The example from the README (which assumes binaries) is given:
The github repo has been linked a handful of times above, but you can also just install it from PyPi with `pip install vizbin`# which files stand out? cluster by their region composition vizbin profile corpus/\*.bin --json | \ jq -r '[(.regions|map(.kind)|unique|join("+")), .source] | @tsv'by ycombiredd - Not exactly the same but https://runhexed.com allows you to create binary visualizations onlineby jakiestfu
- “You get used to it; I don’t even see the code.
“All I see is blonde, brunette, redhead…”
- I have been thinking we should do this for code too. I still haven't had time to execute on this plan, but I think there's probably part of the answer to how to use AI as a tool is how it doesn't automatically give us the same kind of window into what it does. In verbose mode, I've caught things earlier that I wouldn't have caught until later. But even beyond that, it speaks to how we draw lines between code and data and what happens if we erase those lines. What if we applied data vis methods to code? Maybe hierarchical semantic clustering colored by class hierarchy. Not just one floating architecture diagram. But different slices of the codebase.by eigenblake
- It looks neat but I have no idea how the clustering works or why uniform colors are assigned to large areas, e.g. the color blue in the pdf example.by bflesch
- open one and inspect the two ways to view it, one is horizontal scan, the other is a peano curve which leads to natural square-ish areas.by Jare
- This brings back memories! In 93 I wrote something similar (simpler) for MSDOS, to inspect and extract pieces of binary files, GFV (still downloadable from the Hornet archive somewhere in here https://www.hornet.org/cgi-bin/ha_search.cgi?opt_s=5:Iguana). You could set the stride and show 1/n bytes, so it was relatively easy to find textures from game files and memory dumps of running games.by Jare
- Discussion from a few days ago that had links to more visualization tools: https://news.ycombinator.com/item?id=49423878by EvanAnderson
- Love seeing the two example OS binaries side-by-side. Even though I don't know exactly what their differences mean, I feel like I'm getting a good impression of their "Gestalt." Thank you for sharing!by interleave
- Pretty neat. It tangentially reminds me of when we used to be able to hear HDDs clatter away, or waaaaay back when we used be able to hear EM interference from whatever was going on in a computer.
There was an episode of Cowboy Bebop, where a mechanic held a wrench against an engine cowling to see how much it vibrated (likely a real thing people do with real engines?) and, of course, the computer sounds in the Enterprise-D, along with blinkenlights.
All this seems like the same kind of "translate data into a form humans can perceive." I'm not sure what immediate value this utility has, but I like it.
by dejobaan - The wrench thing is real. My approach to a DIY mechanic’s stethoscope is to stick the handle of a screwdriver against my ear and the tip on whatever I want to listen to. Great for figuring out what part of the machine a noise is coming from.by jackyinger
- > There was an episode of Cowboy Bebop, where a mechanic held a wrench against an engine cowling to see how much it vibrated (likely a real thing people do with real engines?)
I was watching a documentary about dirt track racing and they showed one of the mechanics on the team who was blind.
He would put a long screwdriver on the engine and hold the handle to his ear. He could debug timing issues by hearing the vibrations.
There is also the case of the water leak detectors in the UK who use basically a long stick with one end on the ground and the other in their ear. e.g. https://www.youtube.com/watch?v=gVeEoWTsiiw
by alexpotato - I still have a computer that produces slightly different noise (coil whine?) depending what it's doing. Fascinating behavior.by yjftsjthsd-h
- I forget where I read this (maybe PG's blog?) but I read some early 2000s startup had some kind of mechanical device that responded to website visitors, so everyone in the office could hear the traffic in realtime.
I also heard stories of professors who would know a program had a bug based on the sounds the computer was making. (Back when they were slightly slower!)
by andai - I made my own binary visualizer when I was learning C. I had a for-loop which generated a texture by just setting the pixels based on the bytes in the file.
I had two modes, monochrome (the bits) and grayscale (the bytes).
Anyway funny thing happened, I had a buffer overflow and my program ended up visualizing its own memory.
Actually I had the same error another time, I was trying to make a simple Terraria clone (like 2D Minecraft) and the terrain ended up rendering my mouse coordinates interpreted as booleans or something.
C is fun!
by andai - I've also built a visualizer into ClickHouse, so we can analyze its binary: https://play.clickhouse.com/binary?user=binary - which code takes more space, what dependencies are too big, or what template instantiations are bloated.by zX41ZdbW