Imagine: you’ve got a function and you’d like to know how long it takes to run, on average. So you run the function a few times, measuring how long it takes each time, then take the average of those times. That couldn’t possibly be wrong, could it? In this post…

This article is about how we process text before passing it to large language models, the problems with this approach, and an alternative solution. — The Problem With (1D) Tokenization When passing text to a Large Language Model (LLM), text is broken down into a sequence of words and sub-words. This sequence of tokens is then replaced with a sequence of integers and passed to the model. LLMs contain an embedding matrix to store a representation for each of these…

This post is for anyone considering a career move into the field of machine learning. Of course, the answer to the titular question is “it depends”. But what does it depend on, exactly? Rather than try and give some generic answer to the question that suits no one in particular…

There are 7.674 billion people on this planet. Of those, how many are working on innovations that will make the world a better place? A few thousand people? Maybe a hundred thousand, a million? And what about the other 7.673 billion people? Sprinkled throughout are some truly brilliant individuals, people…

The world is currently in the process of rolling out a vaccine that is killing people. Every day, millions of people are getting a jab in the arm that could be their last. This is not disputed. There is, of course, another option: not getting the vaccine. In fact, there…

Putting an end to email scams is so simple that I’ll explain the entire process in one word in the second paragraph. The rest of the article is just padding. Ready to learn what you need to do? Ready?!…. Respond. Now for the padding… The scamming industry is profitable because…

Releasing an npm package is like trekking through the wilderness. The ideal path will depend on how experienced you are, how much of a hurry you’re in, and whether you’re hiking alone or in a group. This post describes one way to plot a course (the best way). Truth be…

Let’s say you want a component that will render a list of things. You want it to be flexible, to be able to render any sort of thing, like this: Or this: The implementation might look something like this: The problem, of course, is that the type…

Hitler wasn’t a violent man. Not in the personal, physical sense. His millions of atrocities were carried out by other people, because he asked them to. This may seem an odd way to phrase things, but I do so because the idea is important: by stringing together the correct sequence…