Morph Labs

Claude Plays Pokémon Hackathon: Escape from Mt. Moon!

Apr 5, 2025 · 1:15:00

David Hershey (creator of Claude Plays Pokémon), Andrew (a developer building a Pokémon-playing virtual streamer), and Jesse Han (Morph Labs CEO) detail how to build agents that escape Mt. Moon in Pokémon FireRed using Anthropic's Claude and Morph Cloud's Infinibranch technology. Hershey explains that Claude's vision is often unreliable—it spent 8 hours pressing A on a doormat thinking it was a dialogue box—and that spatial reasoning remains a core bottleneck, best mitigated by touchscreen controls rather than prompt engineering. Andrew reveals he relied on reading raw RAM and A* pathfinding rather than computer vision, calling it “cheating” but pragmatically useful: his biggest breakthrough was a single prompt line telling the agent to try something else if it fails to grab a starter Pokémon. Jesse introduces Morph's EVA agent framework, which uses low-overhead snapshotting for test-time search, and the hackathon's judging criteria—escape Mt. Moon in the fewest agent turns, with a $1,000 prize for the coolest use of Infinibranch branching. The episode serves as both a technical walkthrough and a challenge to build general-purpose agents that can handle complex, open-ended tasks…

[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx

Dec 1, 2024 · 41:46

Shawn Wang (swyx) surveys four key embedding developments: OpenAI's text-embedding-3 models, Nomic Embed, Jina Embed v3, and CDE-small-v1. OpenAI's models introduce Matryoshka embeddings, compressing output from 1024 to 64 dimensions (94% storage reduction) with only an 8% performance drop. Nomic Embed is a fully open-source BERT-based model trained on English data, offering reproducible code. Jina Embed v3 supports 89 languages and uses task-specific LoRA adapters—e.g., a retrieval adapter yields a huge boost over the base model. CDE-small-v1 (143M parameters) employs a two-stage adaptation: first conditioning on the corpus, then embedding; it outperforms 7B-parameter models on many tasks, though its stateful API complicates deployment.