A sentence-embedding model that fits in 7 MB and runs on your CPU.

Ternary 1.58-bit weights, a tokenizer, and a from-scratch Rust → WASM engine in one bundle. 5 ms per embedding - no server, no API, no GPU. The search on the right is running it right now.

See on GitHub
7.2 MB
engine + model + tokenizer, gzipped
5.1 ms
per embed · p50 · on CPU
195 emb/s
single-thread throughput
1.58-bit
ternary weights, trained from scratch
  1. 01
    Arctic Tern

    Sterna paradisaea

    Makes the longest migration of any animal, flying from Arctic breeding grounds to Antarctic waters and back each year, over 70,000 km, chasing an endless summer.

  2. 02
    Common Tern

    Sterna hirundo

    A slender, silver-grey tern with a black cap and a buoyant, dipping flight. It plunge-dives for small fish just below the surface of coasts and lakes.

  3. 03
    Roseate Tern

    Sterna dougallii

    An elegant, very pale tern with a long forked tail and a faint pink flush in spring. Rare and declining, it nests among other tern colonies.

  4. 04
    Sandwich Tern

    Thalasseus sandvicensis

    A large, shaggy-crested tern with a black bill tipped yellow. It gathers in dense, noisy coastal colonies and dives for fish from a height.

  5. 05
    Wandering Albatross

    Diomedea exulans

    Has the largest wingspan of any living bird, over three metres, letting it glide across the Southern Ocean for hours without a single flap.

Cosine ranked, runs in browserOpen the full demo →

Sterna hirundo · Common Tern