Open in app

Sign In

Write

Sign In

David Gilbertson
David Gilbertson

30K Followers

Home

About

15 hours ago

A keyframe-style learning rate scheduler for PyTorch

When it comes to defining learning rate schedules in PyTorch, you have plenty of options. 15 different scheduler classes, to be exact. This offers good flexibility, but it sometimes means that making a small change to your learning rate schedule requires switching to a different scheduler, or combining multiple schedulers. …

Machine Learning

10 min read

A keyframe-style learning rate scheduler for PyTorch
A keyframe-style learning rate scheduler for PyTorch
Machine Learning

10 min read


Published in

Better Programming

·Updated 18 hours ago

The mean misleads: why the minimum is the true measure of a function’s run time

Imagine: you’ve got a function and you’d like to know how long it takes to run, on average. So you run the function a few times, measuring how long it takes each time, then take the average of those times. That couldn’t possibly be wrong, could it? In this post…

Programming

16 min read

The mean misleads: why the minimum is the true measure of a function’s run time
The mean misleads: why the minimum is the true measure of a function’s run time
Programming

16 min read


Published in

Better Programming

·Updated May 5

2D Tokenization for Large Language Models

This article is about how we process text before passing it to large language models, the problems with this approach, and an alternative solution. — The Problem With (1D) Tokenization When passing text to a Large Language Model (LLM), text is broken down into a sequence of words and sub-words. This sequence of tokens is then replaced with a sequence of integers and passed to the model. LLMs contain an embedding matrix to store a representation for each of these…

Data Science

18 min read

2D Tokenization for Large Language Models
2D Tokenization for Large Language Models
Data Science

18 min read


Published in

Better Programming

·Jan 29

Can you learn machine learning in a year?

This post is for anyone considering a career move into the field of machine learning. Of course, the answer to the titular question is “it depends”. But what does it depend on, exactly? Rather than try and give some generic answer to the question that suits no one in particular…

AI

29 min read

Can you learn machine learning in a year?
Can you learn machine learning in a year?
AI

29 min read


Aug 6, 2021

Smart review: introduction

There are 7.674 billion people on this planet. Of those, how many are working on innovations that will make the world a better place? A few thousand people? Maybe a hundred thousand, a million? And what about the other 7.673 billion people? Sprinkled throughout are some truly brilliant individuals, people…

Climate Change

14 min read

Smart review: introduction
Smart review: introduction
Climate Change

14 min read


Jul 5, 2021

The scientific evidence proving ‘anti-vaxxers’ right

The world is currently in the process of rolling out a vaccine that is killing people. Every day, millions of people are getting a jab in the arm that could be their last. This is not disputed. There is, of course, another option: not getting the vaccine. In fact, there…

Covid-19

3 min read

The scientific evidence proving ‘anti-vaxxers’ right
The scientific evidence proving ‘anti-vaxxers’ right
Covid-19

3 min read


May 12, 2021

We can end email scams tomorrow. Here’s how.

Putting an end to email scams is so simple that I’ll explain the entire process in one word in the second paragraph. The rest of the article is just padding. Ready to learn what you need to do? Ready?!…. Respond. Now for the padding… The scamming industry is profitable because…

Computer Science

16 min read

We can end email scams tomorrow. Here’s how.
We can end email scams tomorrow. Here’s how.
Computer Science

16 min read


May 3, 2021

A workflow guide for npm package authors

Releasing an npm package is like trekking through the wilderness. The ideal path will depend on how experienced you are, how much of a hurry you’re in, and whether you’re hiking alone or in a group. This post describes one way to plot a course (the best way). Truth be…

NPM

11 min read

A workflow guide for npm package authors
A workflow guide for npm package authors
NPM

11 min read


Published in

JavaScript in Plain English

·Apr 18, 2021

React Components as TypeScript Generic Functions

Let’s say you want a component that will render a list of things. You want it to be flexible, to be able to render any sort of thing, like this: Or this: The implementation might look something like this: The problem, of course, is that the type…

React

9 min read

React Components as TypeScript Generic Functions
React Components as TypeScript Generic Functions
React

9 min read


Published in

Predict

·Apr 10, 2021

Can AI agents manipulate you into taking real-world actions?

Hitler wasn’t a violent man. Not in the personal, physical sense. His millions of atrocities were carried out by other people, because he asked them to. This may seem an odd way to phrase things, but I do so because the idea is important: by stringing together the correct sequence…

AI

10 min read

Will fake humans wreak havoc on society?
Will fake humans wreak havoc on society?
AI

10 min read

David Gilbertson

David Gilbertson

30K Followers

I like machine learning stuff.

Following
  • Google Earth

    Google Earth

  • Eric Elliott

    Eric Elliott

  • Ev Williams

    Ev Williams

  • Addy Osmani

    Addy Osmani

  • Mapbox

    Mapbox

See all (34)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech