蚂蚁集团与vLLM联合开源Humming:高性能、灵活的量化推理内核

【蚂蚁集团与vLLM联合开源Humming:高性能、灵活的量化推理内核】金色财经报道,10月21日,蚂蚁集团与vLLM社区联合开源Humming,一个通用、高性能的量化推理算子库。Humming具备以下特点:广泛的设备支持,覆盖多种GPU,以及兼容CUDA编程的设备;丰富的量化支持,通过统一架构支持Dense和MoE中丰富的权重与激活格式组合,覆盖多种整数和浮点类型、位宽及缩放方式。出色的执行性能在多种典型负载中显著优于vLLM Marlin、FlashInfer和DeepGEMM等现有实现。()
热门交易所
排名 # 交易平台 24H成交额 成交涨跌幅 活跃度 交易平台 活跃度
1 $183.61亿 -11.14% 86.7% 86.7%
2 $26.67亿 0.43% 68.6% 68.6%
3 $411.56亿 -8.21% 85.4% 85.4%
4 $9.06亿 -15.45% 69.3% 69.3%
5 $111.99亿 -6.82% 65.3% 65.3%
6 $12.20亿 -8.38% 53.3% 53.3%
7 $2.10亿 19.05% 65.3% 65.3%
8 $7.50亿 -8.9% 68.4% 68.4%
9 $2.82亿 -21.29% 56.9% 56.9%
10 $71.69亿 0.5% 71.1% 71.1%
11 $4.44亿 5.29% 36.2% 36.2%
12 $3,036.35万 -18.81% 59.5% 59.5%
13 $216.40亿 -0.43% 31% 31%
14 $112.90亿 1.25% 76.2% 76.2%
15 $1.42亿 -9.32% 66.9% 66.9%
16 $108.19亿 -12.74% 55.2% 55.2%
17 $11.61亿 -6.31% 26% 26%
18 $15.95亿 26.45% 46.9% 46.9%
19 $1.09亿 -10.8% 31.5% 31.5%
20 $1,661.70万 -20.85% 58.2% 58.2%
今日行情
排名 # 币种 最新价 24H最高 24H最低 24H量 流通市值 24H涨跌幅 币种 最新价 24H涨跌幅
1 $ 83864.3 $8.40万 $8.22万 $8.13亿 $1.68兆 1.16% 1.16%
2 $ 2470.95 $2,497.91 $2,425.58 $2.99亿 $2,982.28亿 1.12% 1.12%
3 $ 1.3595 $1.37 $1.31 $4,398.69万 $828.17亿 2.21% 2.21%
4 $ 745.4 $749.90 $730.90 $989.46万 $1,016.43亿 0.94% 0.94%
5 $ 1.00106 $1.00 $1.00 $4,404.03万 $707.90亿 0% 0%
6 $ 106.7 $108.25 $105.00 $8,692.75万 $604.50亿 -0.25% -0.25%
7 $ 0.3318 $0.33 $0.33 $226.51万 $314.27亿 0.12% 0.12%
8 $ 0.08208 $0.08 $0.08 $1,544.62万 $138.08亿 1% 1%
9 $ 285.17 $290.61 $274.99 $37.81万 $56.97亿 1.77% 1.77%
10 $ 80.6 $82.36 $79.29 $2,264.25万 $273.51亿 -0.59% -0.59%
11 $ 0.22485 $0.23 $0.22 $384.06万 $80.84亿 0.64% 0.64%
12 $ 83616.4 $8.36万 $8.25万 $628.14 $107.79亿 0.81% 0.81%
13 $ 9.029 $9.11 $8.97 $674.15 $83.22亿 -0.14% -0.14%
15 $ 0.1836 $0.19 $0.18 $314.10万 $59.51亿 1.97% 1.97%
16 $ 61.29 $62.19 $59.19 $674.06万 $47.02亿 1.89% 1.89%
17 $ 0.08472 $0.09 $0.08 $251.04万 $36.25亿 0.61% 0.61%
18 $ 1309.13 $1,327.15 $1,175.48 $2,630.94万 $215.70亿 6.78% 6.78%
19 $ 9.639 $9.92 $9.53 $740.05万 $41.47亿 -0.87% -0.87%
20 $ 0.000005184 $0.00 $0.00 $40.28万 $30.55亿 1.72% 1.72%
21 $ 1.0273 $1.04 $1.00 $961.24万 $38.96亿 -0.61% -0.61%
22 $ 0.05798 $0.06 $0.06 $13.72万 $22.38亿 0.19% 0.19%
23 $ 0.05672 $0.06 $0.05 $55.22万 $15.17亿 4.99% 4.99%
24 $ 7.41 $7.79 $7.20 $1,837.51万 $47.07亿 -0.29% -0.29%
25 $ 1.1619 $1.19 $1.14 $156.98万 $19.21亿 -1.01% -1.01%
26 $ 0.5493 $0.55 $0.53 $16.82万 $17.87亿 2.3% 2.3%
27 $ 4135.61 $4,157.34 $4,114.80 $21.01万 $15.75亿 -0.03% -0.03%
28 $ 0.7176 $0.73 $0.71 $371.84万 $17.91亿 0.46% 0.46%
29 $ 154.4 $158.45 $149.96 $1,187.31万 $23.64亿 -0.27% -0.27%
30 $ 0.0000016397 $0.00 $0.00 $1,899.36 $16.40亿 -0.52% -0.52%
31 $ 271.81 $278.50 $266.87 $290.96万 $28.72亿 -0.37% -0.37%
32 $ 116.23 $117.09 $114.23 $349.74万 $24.41亿 1.01% 1.01%
33 $ 0.000004614 $0.00 $0.00 $2,423.22万 $19.41亿 0.85% 0.85%
34 $ 8.056 $8.16 $7.82 $26.58万 $12.49亿 1.89% 1.89%
35 $ 5.185 $5.28 $4.75 $5,603.66万 $66.61亿 6.35% 6.35%
36 $ 2.916 $2.97 $2.84 $51.32万 $15.93亿 0.48% 0.48%
37 $ 0.07991 $0.08 $0.08 $48.92万 $6.70亿 2.16% 2.16%
38 $ 0.5696 $0.60 $0.56 $2,490.27万 $15.41亿 2.13% 2.13%
39 $ 1.741 $1.79 $1.73 $6.35万 $8.48亿 -0.57% -0.57%
40 $ 0.9988 $1.00 $1.00 $800.00万 $9.82亿 0.04% 0.04%
41 $ 0.2064 $0.21 $0.19 $901.89万 $16.42亿 3.92% 3.92%
42 $ 0.9992 $1.00 $1.00 $1.94万 $8.55亿 0.07% 0.07%
43 $ 0.0382 $0.04 $0.04 $292.74万 $10.35亿 4% 4%
44 $ 193.38 $202.97 $192.15 $154.06万 $23.35亿 -2.91% -2.91%
45 $ 0.11197 $0.12 $0.11 $11.20万 $9.90亿 -0.18% -0.18%
46 $ 0.006449 $0.01 $0.01 $10.25万 $5.33亿 0.9% 0.9%
47 $ 0.03473 $0.04 $0.03 $36.90万 $6.63亿 7.55% 7.55%
48 $ 0.8196 $0.84 $0.79 $48.10万 $6.16亿 2.65% 2.65%

快讯

更多