Graduate student in Taiwan. Leader of KohakuLab. Researcher/Dev in ComfyOrg

Taiwan
TT-VidT is accepted at #NeurIPS2026 🎉 A temporal-decoupled methodology in video pretraining to provide real "motion" info extracted from the video and only requires small scale training to reach high quality results. Huge thanks to all collaborators, @NVIDIAAI and @spellbrush
3
9
68
10,923
琥珀青葉@KohakuLab retweeted
想象这样一种可能 你是一个安全研究员,发现了一个非常非常严重,可能影响全球互联网安全的漏洞 于是你找到了存在这个漏洞的厂商,想看看有没有什么漏洞奖金可以拿 查了一下,确实有 但是你转念一想,这漏洞一旦直接披露,大概率会毁了这家公司的商业信用,再严重点,公司能不能活下来都是问题 哪怕是这家公司和你签了保密,修了之后再披露,大概率公司也要名声扫地了,修复这个漏洞的操作本身,已经足以重创这公司的商业信用了 这时候你还指望它给你发奖金?不反过来起诉你就不错了…… 于是你关掉了邮件客户端,开始思考,到底该咋办 转头把漏洞提交给这个产品最大的几个使用方吗,就那几个互联网巨头? 你查了一下,这几个巨头确实都有明确的漏洞奖励计划,有的奖金还相当丰厚 但是你仔细看了看规则,发现他们主要奖励自家产品的漏洞,对于这种第三方基础设施级别的安全问题,似乎谁都没有明确承诺会支付奖金 你开始陷入沉思 与此同时,你无意中发现黑市上有个老哥,正在开天价寻求某种攻击力 你看了一下,用你手上这个漏洞,简直轻而易举 现在,你该怎么办?
40
6
436
67,246
琥珀青葉@KohakuLab retweeted
It is interesting that, ppl don't discuss the risk about use exploit to patch things inside GPU firmware may be dangerous but claiming "NV nerf your performance for stability" or so. BRUH plz check every detail before you discuss anything, NV only nerf "some" specific dtype combination's performance. 1. Tensor core's most heat comes from multiplier, accumulator is very small compare to other part inside tensor core 2. in consumer card, FP16 matmul FP16 accumulation can run in full speed, but FP32 accumulation can only run in half speed. Which means your card can run multiplier in full speed 3. in 50-series, Mxfp8 and NVfp4 can run FP32 accumulation in full speed. which means your accumulator can run in full speed. (those 2 dtype even have more multiplier and need to handle the block scale lol) 4. so there is NO reason such nerf is designed for stability (the difference between 3090/3090ti can be about quality or stablity, some flaw in chip make NV need to block some SM and result in weaker version). And Usually the raw power of pro card is even worse than consumer card (like the SM's frequency, vector FP32 speed, if you compare p6k and 5090 you will find this) The nerf is fully designed for spearate the market of pro card and consumer grade card. and use same design (with firmware cap) is actually cheaper in tape out. The only risk of such "unlock" is if you don't prepare proper fallback entry inside your grub or UEFI, you may lost your OS. That's all. The risk is even smaller than use apt to install nvidia driver.(X)
7
24
197
11,827
Confirmed that 3090 unlock is successful with 360watt power wall, I got 75T -> 135T (measured in Pytorch) Which is insane I used github.com/Zagitta/gpu-unloc… with commit a9b0c75
148
376
5,254
1,179,342
Latest news on 4090: fully reproduced the EFI applicaiton path and provided more details in my repo:
Now thanks to community resources like gpu-unlock-ada or gpu-unlock-4080s. I successfully unlocked my 4090 on "Windows" system. All the details are released in github.com/KohakuBlueleaf/Ko… Plz check it out!
1
1,095
琥珀青葉@KohakuLab retweeted
Now thanks to community resources like gpu-unlock-ada or gpu-unlock-4080s. I successfully unlocked my 4090 on "Windows" system. All the details are released in github.com/KohakuBlueleaf/Ko… Plz check it out!
Confirmed that 3090 unlock is successful with 360watt power wall, I got 75T -> 135T (measured in Pytorch) Which is insane I used github.com/Zagitta/gpu-unloc… with commit a9b0c75
18
42
303
36,045
Now thanks to community resources like gpu-unlock-ada or gpu-unlock-4080s. I successfully unlocked my 4090 on "Windows" system. All the details are released in github.com/KohakuBlueleaf/Ko… Plz check it out!
Confirmed that 3090 unlock is successful with 360watt power wall, I got 75T -> 135T (measured in Pytorch) Which is insane I used github.com/Zagitta/gpu-unloc… with commit a9b0c75
18
42
303
36,045
In the unlock I achieved +80% speed on mmapeak (my modification, which is more accurate, old mmapeak have all zero input which make result unclear) and +50% speed on pytorch. which means 4090 now nearly catch up AIO version 5090 in fp16/bf16.
2
17
2,251
But since 5090 have no-nerf mxfp8/nvfp4 and 2x bandwidth, my benchmark shows after this unlock trend, the ordering is still 5090 > 4090 > 3090 > 2080ti. Which is interesting.
1
1
9
1,691
I have 2x2080ti-22G (modded) and I found 2080ti also have similar unlock stuff from community, I'm trying to make it become initramfs module (easier to recover than the UEFI module design) and see if it works. UwUb
Confirmed that 3090 unlock is successful with 360watt power wall, I got 75T -> 135T (measured in Pytorch) Which is insane I used github.com/Zagitta/gpu-unloc… with commit a9b0c75
7
9
125
5,114
2080ti success
Now I also confirmed that 2080ti unlock is successful with similar approach as the 30-series' method it reach nearly same speed as 350w 3090(locked) with only 250w in mmapeak and mamf-finder github.com/KohakuBlueleaf/Ko…
2
8
981
Remember to check my latest news on 2080ti!
Now I also confirmed that 2080ti unlock is successful with similar approach as the 30-series' method it reach nearly same speed as 350w 3090(locked) with only 250w in mmapeak and mamf-finder github.com/KohakuBlueleaf/Ko…
2
1
73
37,102
琥珀青葉@KohakuLab retweeted
Now I also confirmed that 2080ti unlock is successful with similar approach as the 30-series' method it reach nearly same speed as 350w 3090(locked) with only 250w in mmapeak and mamf-finder github.com/KohakuBlueleaf/Ko…
Confirmed that 3090 unlock is successful with 360watt power wall, I got 75T -> 135T (measured in Pytorch) Which is insane I used github.com/Zagitta/gpu-unloc… with commit a9b0c75
49
97
1,045
165,260
For those who don't know: 1. This unlock the "nerfed FP32 accumulator" stuff 2. you can rent a A6000/6000 ada to test the mmapeak to know what I'm saying (or check the FP16 accumulation speed of 3090/4090) 3. no unlock core, no overclock, it just remove the nerf
6
8
487
79,655
And as this unlock is NOT overclock: 1. if you use kernel mod method, it is riskless 2. won't hurt your card at all (FP16 accumulator already "run in unlocked speed")
1
7
1,786
And as this unlock only happen in tensor core: 1. not help mining, not help gaming 2. only help AI usage (potentially DLSS but not guranteed)
5
7
455
63,512
琥珀青葉@KohakuLab retweeted
Confirmed that 3090 unlock is successful with 360watt power wall, I got 75T -> 135T (measured in Pytorch) Which is insane I used github.com/Zagitta/gpu-unloc… with commit a9b0c75
148
376
5,254
1,179,342
琥珀青葉@KohakuLab retweeted
My iPhone Duo video went viral, so I'm giving away 100 iPhones on X 😛
94,161
96,440
143,718
5,521,864
琥珀青葉@KohakuLab retweeted
Something exciting is coming. 👀✨ We've been working on an anime-focused 2B pretrained DINOv3 model! Our internal evaluations show promising improvements across a wide range of anime-related downstream tasks. We're now making the preparations for release. Stay tuned! 🚀
5
15
150
7,961