I integrated Apple-native NNs running in sidecar and can now run accurate landmarks at a stable 60fps, freeing up GPU for intensive shader work

✨ Glyph v0.1.0 coming out party ✨ The typography engine for the web. Finally, text that looks like it came from a native app in your web pipeline. → gpu-first with batched drawing and incremental updates → bitmap, mtsdf and slug in one engine → correct multilingual text, shaping, bidi, cjk, ligatures, font fallback → paragraphs that wrap, justify, flow around shapes and 3d objects → one font pipeline for three.js, R3F, typegpu or your own renderer github.com/pmndrs/glyph

!!!!!!!

I made a virtual depth of field effect by using the Apple NPU to general real time depth probes and ran it thru the DOF algorithm by Earl Hammon Jr (Infinity Ward) This is just a regular macbook camera. Absolutely bonkers that you can now simulate the properties of DSLR cameras in real time at a stable framerate

That's a new one

My chopped unc take is that games are SUPPOSED to not look too realistic to allow some of the action / story to happen inside of your brain

We have been working so hard on this Advanced R3F workshop and want teach you everything we know about scalable 3D apps and the future of TSL, WebGPU and R3F v10. It is coming to @threejsconf in less than a week. If you are in Paris on the 8th and 9th, check us out. Here is a peek at everything you will build from a (legally generic) voxel game to a product configurator to a website hero. We have limited spots so reach out if you want to join. ➡️Sign up here: threejs.paris/workshop 📷 Learn more: r3f.paris

I made an optical camo filter and hooked it up to NDI and now I can gaslight people on Zoom calls that “I’m not seeing anything weird on my end”

Apple Neural Networks for off axis projection, Claude + Blender MCP to procedurally generate some of the models, FFT analysis + Simplex noise frequency distribution + dual pass glass shader all at a stable 60fps

Reposting this because I found it very cool

Apple Neural Networks are so fast that you can now build off axis projections that use glass shaders and PBR lighting

Another banger from the goat

Me when I miss the entire point of using a VPL

an idea i recently played with: gracefully suspend a webgpu scene when the browser becomes inactive - animations ease to a halt - lights are dimmed - the render loop pauses on the final frame the scene then comes back to life on focus :) → r3f.maximeheckel.com/webgpu/…

This effect got me 1M views on reels. Explaining how the viral virtual shadow projection technique works with real-time parallel face tracking+segmentation running in Sidecar at a stable 60fps, even with high-poly 3D models and complex lighting.

✈️ Our advanced React Three Fiber workshop is happening Sept 8 & 9 at @threejsconf and it is FOUR workshops in one. You get to preview R3F v10, our new tech stack and walk away with a cool app of your choice. 👉 r3f.paris/ Day 1: Learn the full R3F v10 WebGPU stack from staging to reactivity to TSL and postprocessing. We'll break down the Paris hero and more. Day 2: Build something amazing. Choose between a game, product editor or creative portfolio or even all three if you are ambitious enough. Each tract is headed by one our pros: ✧ @DennisSmolek: Author of R3F v10 and more at Poimandres. ✧ Kris Baumgartner: Organizer, Koota author, and general maintainer at Poimandres. ✧ @CantBeFaras: Senior graphics programmer, technical artist, and maintainer at Poimandres. ✧ And supported by Poimandres dev Ava Lehner. A great amount of work has gone into this and we are excited to make something special with you in Paris. Sign up here: threejs.paris/workshop

Realtime depth maps are so hot right now. Running realtime depth estimation (with my fixed relative algo), face tracking and the dual-pass refraction shader (pioneered by @MaximeHeckel ). Comment GitHub for the repo.

Can't let Konrad have all the fun. I built a realtime TD network running both depth and landmark tracking natively on the M4 Pro's GPU, stable at 60fps. GitHub repo here: github.com/ojrgb/appletd

Quick look at the blobtrack effect I made for @MaximeHeckel ‘s blog. Some math involved to get the videos side by side and it uses the custom Dither + digital crunch effect rack for that retro Gameboy Advance feel.

Maxime’s excellent blog post on motion based shaders (which coincidentally includes some of my work). 🫡