"What do they want?"
This is the standard way to refer to an unknown person in English, anything else sounds awkward. "What does the person want", "what does he or she want", "what does this 'someone' want", none of these will sound natural to a native speaker.
There's not a man I meet but doth salute me As if I were their well-acquainted friend
English has always used the singular they, especially (but not always) when the gender of the target of the pronoun is unknown.
I built a small language model in Minecraft using no command blocks or datapacks! I built a small language model in Minecraft using no command blocks or datapacks!
The model has 5,087,280 parameters, trained in Python on the TinyChat dataset of basic English conversations. It has an embedding dimension of 240, vocabulary of 1920 tokens, and consists of 6 layers. The context window size is 64 tokens, which is enough for (very) short conversations. Most weights were quantized to 8 bits, although the embedding and LayerNorm weights are stored at 18 and 24 bits respectively. The quantized weights are linked below; they are split into hundreds of files corresponding to the separate sections of ROM in the build.
The build occupies a volume of 1020x260x1656 blocks. Due to its immense size, the Distant Horizons mod was used to capture footage of the whole build; this results in distant redstone components looking strange as they are being rendered at a lower level of detail.
It can produce a response in about 2 hours when the tick rate is increased using MCHPRS (Minecraft High Performance Redstone Server) to about 40,000x speed.Microsoft owns Minecraft; so they'll just swirl the numbers together with Minecraft sales to show their AI is already profitable.
Oh. I thought this would be some cheesy command block curl to Chat GPT.
https://learn.microsoft.com/en-us/minecraft/creator/scriptap...
>The @minecraft/server-net module contains types for executing HTTP-based requests. This module can only be used on Bedrock Dedicated Server. These APIs do not function within the Minecraft game client or within Minecraft Realms.
Surely this wasn't all done in a block editor by hand?
There was some code shown at beginning. Was that placing the blocks to build each section?
And, more info on the system that could run this.
You still need to come up with the circuitry for all the maths and figure out how to represent all the state with red stone, but once you get the little bits done it’s quite a quick process filling in weights and duplicating logic sections
There are a few projects out there for vhdl and verilog to redstone.
Bravo to you, sir.
But no. The author actually embedded a small LLM in Minecraft using hundreds of millions of blocks, that generates 1 token per 2h at 40,000x speed.
Bravo. I wouldn’t have even thought to try.
It should answer some of the questions/clear up some of the confusion raised here (e.g. how they get the weights in).
4-bit is small enough that you can build it manually, without the use of external tools (which I don't think existed at the time anyways).
Highly recommended for children interesting in computing!
>> by Nisan and Schocken, and implementing a 4-bit CPU in Minecraft.
You confused me there, the book doesn't cover Minecraft, you did that yourself after reading the book, got it.
The book is absolutely fantastic, it is the basis for the "From Nand to Tetris" courses: https://www.nand2tetris.org/
I haven't digested it in full and with a title like that and the boring cover I always have to scramble to find it when I got a few minutes (What is that "Nand to Tetris" book called again?)
This surprised me at first because I remember using Python to create Minecraft maps early on, or at least in the beta.
But it seems like redstone was added in the alpha, and the earliest commits of pymclevel (which I think I used) also dates back to the alpha. So there might indeed have been a time window of a few months in which redstone was available but not tooling for creating maps.
Even if tools to programmatically create maps were available, I wouldn't have known how to program. So this is more about my lack of knowledge of tools of the time.
It's impressive either way but the manual version seems ... impossible.
[1]: https://www.google.com/search?q=%281020+*+260+*+1656%29+seco...
- Re-implements parts of Minecraft
- Runs 512x512 plots in different threads
- Compiles Redstone applying different kind of optimization passes https://github.com/MCHPR/MCHPRS/blob/master/docs/Redpiler.md
- It had Jit backends before, but seems they have been removed
Most recently: Can AI (actually) beat Minecraft? - https://www.youtube.com/watch?v=Wh4abvcUj8Q
https://www.youtube.com/watch?v=FCnQvdypW_I
Invokes shades of Iain M. Banks' "Surface Detail" Culture novel, where virtual Hells are a major plot point.
sim7c00•4mo ago