Where it\u2019s so weird is that it\u2019s only for playback purpose: no way to interact at the lib level with channels and parameters of MIDI data! Why would you absolutely just play a mod file instead of any pcm stream, I don\u2019t know.<\/p>\n
To add to the mess there is the tracker<\/a>, the most annoying and unnatural way to create music. I don\u2019t want to argue about the fact that it can do great music, it does. But we shouldn\u2019t have to deal with the tracker if we want something with MIDI + samples\/synths. Like it or not, we don\u2019t have to enter music on computer keyboard in hexadecimal anymore.<\/p>\n So because the MOD file while supported is definitely depreciated, because the tools are awful, it\u2019s pretty much useless for game development.<\/p>\n OpenAL<\/a>? No MIDI, bye. OpenSL<\/a>? Just started for mobile, there\u2019s MIDI, there\u2019s a mapping of its data<\/a> \u2013I like to read SLMIDIMuteSoloIt<\/em>– but there\u2019s no designer tools (and what the fuck these profiles mean? 3D Audio for games? On mobile? Please). SDL<\/a>? No MIDI.<\/p>\n There\u2019s the BASS audio lib<\/a> that is supporting the playback and manipulation of MIDI files and real-time events through soundfonts<\/a>, it\u2019s cross-platform but I\u2019ve never been able to see a game using it. People use BASS to build their own little tracker or MIDI player. Soundfonts are pretty much dead too.<\/p>\n The Miles Sound System seems to do everything right according to this page<\/a>\u2026 But it\u2019s 4000$ so I never tried it.<\/p>\n That\u2019s it. No widely available tool to help you create sound interactivity with MIDI. Microsoft had this amazing thing called DirectMusic Producer<\/a> but they killed it when they shut down the MIDI part of Windows with Vista\u2019s brand new audio stack. They did that to simplify APIs I guess and also because nobody wanted to use MIDI (I\u2019ll get to that in part 3) but man, that was annoying to witness.<\/p>\n Since then, it\u2019s all about 3D. I never really got this obsession with 3D audio. There\u2019s way too much tools for it compared to the number of people or games actually using this feature (FPS and hardcore gamers, and? Who is playing with a nice 5.1 setup? People spent like crazy for their big ass TV and thought \u201cfuck it\u201d<\/em> for the audio gear, for what I saw).<\/p>\n Main tools and audio engines like Fmod and Wwise<\/a> are providing designer tools aiming for \u201cvolume\u201d<\/em> features, things helping to manage huge amount of streams and sound fxs, localization files etc. Which is fine but it\u2019s now a very small part of the game development market! Teams, projects are shrinking heavily (for the best) these days.<\/p>\n I tried to get more specific about file formats. <\/p>\n The sequencer of your choice export data in .mid (ubiquitous format), the soundbank for the sampler is provided either with dls (industry standard and there are tools to edit them<\/a>) or sfz (Cakewalk\u2019s take on soundbanks), the advantage of sfz being that it\u2019s highly flexible<\/a> and completely free. Plus, you just need a text editor to change things, I know programmers would be really happy with that :-) I use this format all the time and it\u2019s really nice.<\/p>\n Then, .mid\/.dls\/.sfz are mixed together and controlled by scripts. I\u2019d go for Python in terms of readability but all of them would probably work perfectly. The output would be a Fmod-like pair of files separating data\/content. It could almost be only done ala command line style!<\/p>\n I added a door in the synth\/filter part of the engine so that if someone wants to throw in their own filters or synths they have already coded, they can (VST format). <\/p>\n Also overall, the GPU could be used to take care of heavy processing synthesis systems or shit like that. <\/p>\n I see many advantages with this MIDI game audio engine:<\/p>\n -A strong personality and interactivity: the game audio designer set up a \u201cband\u201d<\/em> and makes it play \u2013in every way- with the game.<\/p>\n -High scalability: the .mid can be reused with minimum efforts on any platform, only the \u201cband\u201d<\/em> needs re-design. It\u2019s the fun part, it\u2019s like changing textures in an environment. You can have samples in 24bits 192KHz if you want or minimize to 8bits 16KHz for a small game on a phone, no problem.<\/p>\n -Efficiency: .mid are a few Kb, .dll are a few dozens of Kb and soundbanks are the size you want. Between the compression settings and what your \u201cband\u201d<\/em> is, I\u2019m sure an uncompressed 100 Mb soundbank \u2013in RAM- would provide more than enough for a majority of games. Graphic cards have 1 Gb dedicated c<\/p>\n -Stability: editing scripts in a text editor or a free IDE is stable. Editing soundbanks in a text editor is stable. Exporting midi is trivial. Maintenance would be kept at the minimum, only the audio engine would need it. That\u2019s huge!<\/p>\n Anyway, it\u2019s just some thoughts.<\/p>\n Next time I\u2019ll talk about the social-economics of the game audio engine.<\/p>\n","protected":false},"excerpt":{"rendered":" The goal would be to provide a toolset a game audio designer could use to: -Make him able to be free and creative by using his\/her standard sequencer software and export midi\/soundbanks\/scripts in a convenient and efficient way to the game. -Minimize the programmer\u2019s work who would spend NO time on things he\/she shouldn\u2019t do […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[6],"tags":[],"_links":{"self":[{"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/posts\/1276"}],"collection":[{"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/comments?post=1276"}],"version-history":[{"count":0,"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/posts\/1276\/revisions"}],"wp:attachment":[{"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/media?parent=1276"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/categories?post=1276"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/har0ld.com\/playground\/wp-json\/wp\/v2\/tags?post=1276"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}What we need<\/h1>\n
![\"\"](\"http:\/\/static.flickr.com\/2659\/5703007875_0d9199ab9a.jpg\")
<\/a>
My handwriting sucks, I know<\/em><\/p>\n