frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Understanding LucasArts' iMUSE System

https://github.com/meshula/LabMidi/blob/main/LabMuse/imuse-technical.md
83•todsacerdoti•5h ago

Comments

riotnrrd•4h ago
I worked with Nick back in the ILM R&D group. He's an incredibly kind man and one of the best developers I've ever met; truly a genius.
i_v•4h ago
I was obsessed with the idea of music production as an engine within a game a long time ago. It was just something I came across in passing when I read about how Elder Scrolls Online created a soundtrack in a similar manner. This resurfaced in my mind again when I started digging into Suno and other AI-generated music recently and it's kind of fun to wonder what'll be possible with storytelling in games and visual novels with the ability to limitlessly adapt and change based on player interactions.
canpan•4h ago
If I remember correctly, another game with a similar music system is Deus Ex from 2000. It is pretty approachable. If you own a copy, open any of the s3m music files in your favorite mod tracker editor. Each song file contains multiple versions of song sequences, depending on the mood (idle, battle, ...).
all2•4h ago
I remember reading a PC Magazine article about Rogue Squadron for the N64. Apparently it was one of the first games to feature a context specific soundtrack.
alabastervlog•3h ago
First one I remember it in was X-Wing (1993), five years before Rogue Squadron. Looks like Monkey Island 2 (1991) was the first to use the system. Dark Forces used it, too.
kjander79•3h ago
The iMuse system really is remarkable. Games like X-Wing took great advantage of the features, when a Star Destroyer jumps into the game the music would seamlessly transition to the imperial March and it felt just like being in the movies. I don't think any modern system even tries to do those seamless transitions from one music piece to another.

One thing I wonder about .. he mentions CD-audio (Redbook?) as being one capability of the system. But the CD-Audio games like X-Wing vs Tie Fighter were much more limited in that sense. You'd literally just hear the music switch to the new track. And the Force Unleashed, the last game that used iMuse, wasn't particularly remarkable if memory serves. I wonder if that was a limitation they just couldn't quite make as seamless?

I figure today you could do it, with a "virtual MIDI" system using MP3 audio of individual instrument sounds ..

Edited to add: that last sentence is essential what a DAW provides.

gmueckl•3h ago
Games today feature dynamic music with loops and transitions and individual stems that can be remixed at runtime. One prominent example (to me, at least) is "Take Control" playing over the Ashtray Maze in Control. This sounds like an absolutely seamless prog metal song while playing, but it is actually highly reactive to the gameplay - the rapid-fire sequence of battle arenas and fast paced corridors. The player stays in absolute control of the pacing the whole time.
zerocrates•59m ago
Hi-Fi Rush did some of the opposite: the gameplay in certain parts shrinks or stretches so it takes the right amount of time to hit the next musical cue.
modeless•3h ago
X-Wing just had great music. Even the original stuff was great. The music for the training run was perfect.

Modern games have similar reactive music systems but I've never heard one I felt was better than X-Wing's. They got it right on the first try.

xyzzy_plugh•1h ago
What made these games different was that the musical themes were significant and well known long before you installed your SoundBlaster. The music was mixed at high intensity out of the box allowing it to influence you, each track tailored to the moment.

This gave the series a leg up in that the music could actually communicate information effectively -- a tense moment, the shifting tide of the battle, the calm after a victory -- whereas other games simply had to put up waveforms that sounded pleasing.

To be fair many games experimented with sound design in this era, but few had such legendary IP to build with. An unfair advantage to say the least. The folks wielding iMUSE clearly knew what they had.

crq-yml•1h ago
CD and other formats create trade-offs vs MIDI event sequences - it's a simple playback method offering a lot of fidelity but in exchange, you're tied to having either "one track at a time and the CD spins up in between" (Redbook CD), cueing uncompressed sampled tracks(feasible but memory intensive) or cueing one or more lossy-compressed streams(which added performance or hardware-specific considerations at the time, and in many formats, also limits your ability to seek to a particular point during playback or do fine-grained alterations with DSP). So as a dynamic music system it tends to lend itself to brief "stings" like the Half-Life 1 soundtrack, or simple explore/combat loops that crossfade or overlay on each other. Tempo and key changes have been off the table, at least up until recently(and even then, it really impacts sound quality). DJ software offers the best examples of what can be done when combining prerecorded material live and there are some characteristic things about how DJs perform transitions and mashups which are musically compelling but won't work everywhere for all material.

MIDI isn't really that much better, though - it's a compatibility-centric protocol, so it doesn't get at the heart of the issue with dynamic audio of "how do I coordinate this". All it is responsible for is an abstract "channel, patch number, event" system, leaving the details involved in coordinating multiple MIDI sequences and triggering appropriate sounds to be worked out in implementation. An implementation that does everything a DAW does with MIDI sequences has to also implement all the DSP effects and configuration surfaces, which is out of scope for most projects, although FMOD does enable something close to that.

I think the best approach for exploring dynamic and interactive right now is really to make use of systems that allow for live coding - Pure Data, Supercollider, etc. These untangle the principal assumptions of "either audio tracks or event sequences" and allow choice, making it more straightforward to coordinate everything centrally, do some synthesis or processing, some sequencing, adopt novel methods of notation. The downside is that these are big runtimes with a lot of deployment footprint, so they aren't something that people just drop into game engines.

Sharlin•59m ago
> I figure today you could do it, with a "virtual MIDI" system using MP3 audio of individual instrument sounds ..

Reinventing tracker music, in other words? =D

forrestthewoods•47m ago
> I don't think any modern system even tries to do those seamless transitions from one music piece to another.

Games definitely do this.

gmueckl•3h ago
A music player that is able to change the music dynamically is neat in itself, but to me the true story behind systems like these is the tools and processes used to create the content for them. Making a technical system approachable to a creative mindset is at least as much of a challenge as the system itself.

iMUSE was used for some really beautiful music in its time, so LucasArts had this figured out. But I'd be curious to learn how they did it.

Fastvlm: Efficient vision encoding for vision language models

https://github.com/apple/ml-fastvlm
156•nhod•3h ago•31 comments

Open Hardware Ethernet Switch project, part 1

https://serd.es/2025/05/08/Switch-project-pt1.html
48•luu•3d ago•4 comments

Air Traffic Control

https://computer.rip/2025-05-11-air-traffic-control.html
112•1317•1d ago•20 comments

The Barbican

https://arslan.io/2025/05/12/barbican-estate/
444•farslan•13h ago•156 comments

A conversation about AI for science with Jason Pruet

https://www.lanl.gov/media/publications/1663/0125-qa-jason-pruet
135•LAsteNERD•8h ago•106 comments

How to avoid P hacking

https://www.nature.com/articles/d41586-025-01246-1
42•benocodes•3d ago•39 comments

Understanding LucasArts' iMUSE System

https://github.com/meshula/LabMidi/blob/main/LabMuse/imuse-technical.md
83•todsacerdoti•5h ago•14 comments

Can you trust that permission pop-up on macOS?

https://wts.dev/posts/tcc-who/
217•nmgycombinator•10h ago•157 comments

RIP Usenix ATC

https://bcantrill.dtrace.org/2025/05/11/rip-usenix-atc/
147•joecobb•12h ago•33 comments

HealthBench – An evaluation for AI systems and human health

https://openai.com/index/healthbench/
132•mfiguiere•10h ago•120 comments

Wtfis: Passive hostname, domain and IP lookup tool for non-robots

https://github.com/pirxthepilot/wtfis
54•todsacerdoti•6h ago•4 comments

FedRAMP 20x – One Month in and Moving Fast

https://www.fedramp.gov/2025-04-24-fedramp-20x-one-month-in-and-moving-fast/
64•transpute•4h ago•46 comments

15 Years of Shader Minification

https://www.ctrl-alt-test.fr/2025/15-years-of-shader-minification/
5•laurentlb•2d ago•0 comments

Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL

106•winwang•12h ago•65 comments

NASA study reveals Venus crust surprise

https://science.nasa.gov/science-research/astromaterials/nasa-study-reveals-venus-crust-surprise/
52•mnem•3d ago•52 comments

A community-led fork of Organic Maps

https://www.comaps.app/news/2025-05-12/3/
283•maelito•16h ago•187 comments

University of Texas-led team solves a big problem for fusion energy

https://news.utexas.edu/2025/05/05/university-of-texas-led-team-solves-a-big-problem-for-fusion-energy/
220•signa11•16h ago•155 comments

Policy of Transience

https://www.chiark.greenend.org.uk/~sgtatham/quasiblog/transience/
17•pekim•2d ago•0 comments

Reviving a modular cargo bike design from the 1930s

https://www.core77.com/posts/136773/Reviving-a-Modular-Cargo-Bike-Design-from-the-1930s
148•surprisetalk•14h ago•125 comments

Ruby 3.5 Feature: Namespace on read

https://bugs.ruby-lang.org/issues/21311
188•ksec•14h ago•88 comments

Build your own Siri locally and on-device

https://thehyperplane.substack.com/p/build-your-own-siri-locally-on-device
131•andreeamiclaus•9h ago•29 comments

Writing N-body gravity simulations code in Python

https://alvinng4.github.io/grav_sim/5_steps_to_n_body_simulation/
90•dargscisyhp•2d ago•20 comments

Show HN: Lumoar – Free SOC 2 tool for SaaS startups

https://www.lumoar.com
64•asdxrfx•9h ago•25 comments

The Beam

https://www.erlang-solutions.com/blog/the-beam-erlangs-virtual-machine/
50•Alupis•3d ago•5 comments

Continuous glucose monitors reveal variable glucose responses to the same meals

https://examine.com/research-feed/study/1jjKq1/
169•Matrixik•2d ago•98 comments

Legion Health (YC S21) is hiring engineers to help fix mental health with AI

https://www.workatastartup.com/jobs/75011
1•the_danny_g•11h ago

Universe expected to decay in 10⁷⁸ years, much sooner than previously thought

https://phys.org/news/2025-05-universe-decay-years-sooner-previously.html
187•pseudolus•18h ago•236 comments

Why the 737 MAX Has Been Such a Headache for Boeing

https://www.jalopnik.com/1853477/boeing-737-max-incidents-aircraft-problems/
9•cebert•1h ago•1 comments

Demonstrably Secure Software Supply Chains with Nix

https://nixcademy.com/posts/secure-supply-chain-with-nix/
87•todsacerdoti•13h ago•55 comments

The Acid King (2001)

https://www.rollingstone.com/feature/acid-lsd-king-william-leonard-pickard-prison-pete-wilkinson-184390/
51•udit99•3d ago•39 comments