🚀⚙️ JavaScript Visualized: the JavaScript Engine
Lydia Hallie
・4 min read
JavaScript is cool (don't @ me), but how can a machine actually understand the code you've written? As JavaScript devs, we usually don't have to deal with compilers ourselves. However, it's definitely good to know the basics of the JavaScript engine and see how it handles our human-friendly JS code, and turns it into something machines understand! 🥳
| Note: This post is mainly based on the V8 engine used by Node.js and Chromium-based browsers.
The HTML parser encounters a script
tag with a source. Code from this source gets loaded from either the network, cache, or an installed service worker. The response is the requested script as a stream of bytes, which the byte stream decoder takes care of! The byte stream decoder decodes the stream of bytes as it’s being downloaded.
The byte stream decoder creates tokens from the decoded stream of bytes. For example, 0066
decodes to f
, 0075
to u
, 006e
to n
, 0063
to c
, 0074
to t
, 0069
to i
, 006f
to o
, and 006e
to n
followed by a white space. Seems like you wrote function
! This is a reserved keyword in JavaScript, a token gets created, and sent to the parser (and pre-parser, which I didn't cover in the gifs but will explain later). The same happens for the rest of the byte stream.
The engine uses two parsers: the pre-parser, and the parser. The pre-parser only checks the tokens early to see if there are any syntactical errors ❌. This can reduce the amount it takes to spot errors in the code, which otherwise would’ve been discovered later by the parser!
If there are no errors, the parser creates nodes based on the tokens it receives from the byte stream decoder. With these nodes, it creates an Abstract Syntax Tree, or AST. 🌳
Next, it's time for the interpreter! The interpreter which walks through the AST, and generates byte code based on the information that the AST contains. Once the byte code has been generated fully, the AST is deleted, clearing up memory space. Finally, we have something that a machine can work with! 🎉
Although byte code is fast, it can be faster. As this bytecode runs, information is being generated. It can detect whether certain behavior happens often, and the types of the data that’s been used. Maybe you've been invoking a function dozens of times: it's time to optimize this so it'll run even faster! 🏃🏽♀️
The byte code, together with the generated type feedback, is sent to an optimizing compiler. The optimizing compiler takes the byte code and type feedback, and generates highly optimized machine code from these. 🚀
JavaScript is a dynamically typed language, meaning that the types of data can change constantly. It would be extremely slow if the JavaScript engine had to check each time which data type a certain value has.
Instead, the engine uses a technique called inline caching. It caches the code in memory, in the hope that it will return the same value with the same behavior in the future! Say a certain function is invoked a 100 times and has always returned the same value so far. It will assume that it will also return this value the 101st time you invoke it.
Let’s say that we have the following function sum, that’s (so far) always been called with numerical values as arguments each time:
This returns the number 3
! The next time we invoke it, it will assume that we’re invoking it again with two numerical values.
If that’s true, no dynamic lookup is required, and it can just use the result stored in the specific memory slot it already had a reference to. Else, if the assumption was incorrect, it will de-optimize the code and revert back to the original byte code instead of the optimized machine code.
For example, the next time we invoke it, we pass a string instead of a number. Since JavaScript is dynamically typed, we can do this without any errors!
This means that the number 2
will get coerced into a string, and the function will return the string "12"
instead. It goes back to executing the interpreted bytecode and updates the type feedback.
I hope this post was useful to you! 😊 Of course, there are many parts to the engine that I haven't covered in this post (JS heap, call stack, etc.) which I might cover later! I definitely encourage you to start to doing some research yourself if you're interested in the internals of JavaScript, V8 is open source and has some great documentation on how it works under the hood! 🤖
V8 Docs || V8 Github || Chrome University 2018: Life Of A Script
Feel free to reach out to me! Twitter || Instagram || GitHub || LinkedIn
FAQ: I use Keynote to make the animations and screen record it lol. Feel free to translate this blog to your language, and thanks so much for doing so! Just keep a reference to the original article and let me know if you've translated it please! 😊
Although you didn't cover the whole story of it, this is a decent explanation of how JavaScript engine works. All those gifs are amazing. They help my brain to solidify the theories. Thank you so much. I'm looking forward to your upcoming posts.
Thanks!
Thanks for the informative post. Your animations are superb! I am interested to know which software did you use to create your animations?
This is amazing!! I wish I'd had this at my coding bootcamp last year. I don't think it would have all sunk in at first but seeing it laid out visually would have helped things click at certain points as we learned more. I'm sharing it with them right now so future cohorts will be able to use this resource 🙌🙌🙌
Thanks!! 😃 Hope it’ll help them!
This is brilliant and a great place to start for anyone exploring how JS works its magic. I know this had to have taken a lot of time and effort to create. Thank you for your efforts!!!!
Thanks so much 😃
This might not be important but,i just want you to know that this post was featured in the December 17th, 2019 edition of esnextnews curated by Dr Axel Rauschmayer and Johannes Weber.
Congrats!
Nice post. Very comprehensive. I shared it on our JS group
I'm gonna call you a TV series cause you've left me hangin' on a cliff. Great, great write-up and, I think I speak for everyone when I say we want more. Neh, we need more. For example, regarding "Say a certain function is invoked a 100 times...", I'm curious what the magic number is and how it was determined. Is it always 100 or does the compiler determine at run-time? And, armed with that information, how can we write more efficient JavaScript code?
Thanks you for all explanation. I've been looking for this information for a long time .
But with what tool do you make these wonderful gifs ? :)
I use Keynote!
Apple Keynote? really? I did not know it was good to do that :-)
Haha yeah you can export it to animated gifs :)
Thank you very much ! :D
Very good job on this article! You broke it down to really easy to understand bits!
This brought up a question, and assuming I am understanding this correctly. There are parser nodes that signify a group of tokens that represent a single parser. For example, a single parser contains tokens about a single function.
With that said, what is faster? Having your JS code that is all in a single parser with more tokens or more parser's with less tokens?
I'd assume it depends on the case of how many parser's there are, because you could theoretically search for parser's in O(nlogn), with O(n) tokens, but at some point, if there are so many parser's, a single parser with more tokens would make sense.
Thank you Lydia for this amazing explanation!
I am a language without a compiler but I have an engine (called sometimes a compiler). This engine is a place where 4 of my sons are playing. The first one called "Byte Stream Decoder" which creates tokens. These tokens are sent to the second one called "Parser" which creates nodes. These nodes are parts of the third one called "Abstract Syntax Tree". The last one called "Interpreter" ends the game by climbing the tree and getting the disk containing Byte Code. I forgot, I have also a daughter called "Inline Caching" which takes care of this disk and try to optimise it. I am JAVASCRIPT!
Lydia hi!
This is a very good project.I always wanted see a some kind of visual presentation for programming languages.I am new to programming and i have many questions in general but this helped me a lot.I hope to continue doing this for javascript or for another language.
Thanks.
Thanks for the overview!
Question for you and the group: at what point in this process are scopes and lookup tables created for the various variable bindings and the values the hold? 🤔
Since variable bindings and their declared values need to make it into the byte code, I would think this happens prior to running the interpreter. And it seems like that process would require access to either the raw tokens created by the byte stream decoder, or the AST generated by the parser, because the code needs to be 'crawled' in a meaningful way so as to identify the bindings that have been declared.
Can anyone clarify for me?
In reference to your inline caching example, if you had a function that was called every other time with different data types (“sum” could be called with numbers, then strings, then numbers again repeatedly), wouldn’t the performance of having to update the type feedback be nullified? If so, how is this handled in the V8 engine? Thanks!
Thank you Lydia, that was for me, as an Java developer, the exact amount of information and lovely illustration needed to get an overview how the Javascript engine works.
Thanks, it's a good intro to the V8 which sometimes we see as a distant complex obscure thing.
Stunning visualizations!
Thanks!
Thanks for this amazing explanation. BTW which tool/app do you use to make those awesome GIF animations? Thanks in advance.
What tool are you using for animations?
In another comment thread, she states that she is using Apple Keynote
Gr8 visualization, can you help to create one on those?
I am working on a visualization project for DS and algorithm.
geeksforgeeks.web.app/
Thanks for asking, but I'm afraid I'm tied up on other projects at the moment. However, you might want to reach out to the author of this article to find out how she created it and what tools she used to make the diagram.
I believe it was for the author only
Doh! Sorry about that.
The graphical explanation I didn't know I needed. Great work.
This is so detailed and beautifully written with those illustrations!
What a clear explanation of JavaScript engine and how it works 😮
Good post!
Really nice article! Like the visuals!
Wow! This is really cool. I did a talk on this subject before, but your gifs do such a great job (wish I had seen them when I was learning) !
It's very interesting!
Great article! Thanks for the explanation
Amazing, thanks!
Amazing!
Amazing!
awesome