蚂蚁集团与vLLM联合开源Humming:高性能、灵活的量化推理内核

【蚂蚁集团与vLLM联合开源Humming:高性能、灵活的量化推理内核】金色财经报道,10月21日,蚂蚁集团与vLLM社区联合开源Humming,一个通用、高性能的量化推理算子库。Humming具备以下特点:广泛的设备支持,覆盖多种GPU,以及兼容CUDA编程的设备;丰富的量化支持,通过统一架构支持Dense和MoE中丰富的权重与激活格式组合,覆盖多种整数和浮点类型、位宽及缩放方式。出色的执行性能在多种典型负载中显著优于vLLM Marlin、FlashInfer和DeepGEMM等现有实现。()
热门交易所
排名 # 交易平台 24H成交额 成交涨跌幅 活跃度 交易平台 活跃度
1 $181.89亿 -11.36% 86.7% 86.7%
2 $25.86亿 0.43% 68.6% 68.6%
3 $395.04亿 -7.98% 85.4% 85.4%
4 $9.20亿 -14.88% 69.3% 69.3%
5 $107.31亿 -6.86% 65.3% 65.3%
6 $12.41亿 -8.47% 53.3% 53.3%
7 $2.10亿 19.17% 65.3% 65.3%
8 $7.22亿 -9.02% 68.4% 68.4%
9 $2.86亿 -20.71% 56.9% 56.9%
10 $70.41亿 0.5% 71.1% 71.1%
11 $4.29亿 5.52% 36.2% 36.2%
12 $3,011.34万 -18.35% 59.5% 59.5%
13 $213.94亿 -0.43% 31% 31%
14 $110.81亿 1.29% 76.2% 76.2%
15 $1.44亿 -9.58% 66.9% 66.9%
16 $104.81亿 -12.33% 55.2% 55.2%
17 $11.83亿 -6.44% 26% 26%
18 $16.19亿 26.76% 46.9% 46.9%
19 $1.08亿 -10.82% 31.5% 31.5%
20 $1,637.09万 -20.75% 58.2% 58.2%
今日行情
排名 # 币种 最新价 24H最高 24H最低 24H量 流通市值 24H涨跌幅 币种 最新价 24H涨跌幅
1 $ 83765.8 $8.39万 $8.19万 $8.13亿 $1.67兆 2.24% 2.24%
2 $ 2469.63 $2,497.91 $2,401.37 $2.99亿 $2,980.68亿 2.79% 2.79%
3 $ 1.3564 $1.37 $1.30 $4,403.64万 $826.28亿 3.98% 3.98%
4 $ 745.3 $749.90 $730.90 $989.02万 $1,016.29亿 1.74% 1.74%
5 $ 1.00103 $1.00 $1.00 $4,420.98万 $707.88亿 -0.01% -0.01%
6 $ 106.73 $108.25 $104.68 $8,799.74万 $604.67亿 1.91% 1.91%
7 $ 0.3319 $0.33 $0.33 $229.81万 $314.37亿 0.39% 0.39%
8 $ 0.08214 $0.08 $0.08 $1,548.37万 $138.18亿 3% 3%
9 $ 285.4 $290.61 $274.29 $40.89万 $57.02亿 4.04% 4.04%
10 $ 80.6 $82.36 $79.29 $2,284.31万 $273.51亿 1.6% 1.6%
11 $ 0.22524 $0.23 $0.22 $389.17万 $80.98亿 3.39% 3.39%
12 $ 83616.4 $8.36万 $8.25万 $644.66 $107.79亿 1.21% 1.21%
13 $ 9.029 $9.11 $8.97 $674.15 $83.22亿 -0.14% -0.14%
15 $ 0.18393 $0.19 $0.18 $318.57万 $59.62亿 4.06% 4.06%
16 $ 61.4 $62.19 $59.09 $676.17万 $47.10亿 3.8% 3.8%
17 $ 0.08499 $0.09 $0.08 $249.73万 $36.37亿 2.95% 2.95%
18 $ 1311.15 $1,327.15 $1,165.53 $2,621.58万 $216.03亿 12.33% 12.33%
19 $ 9.667 $9.92 $9.51 $729.94万 $41.59亿 1.56% 1.56%
20 $ 0.000005203 $0.00 $0.00 $39.24万 $30.66亿 3.87% 3.87%
21 $ 1.0304 $1.04 $1.00 $1,050.25万 $39.07亿 2.52% 2.52%
22 $ 0.0583 $0.06 $0.06 $14.19万 $22.50亿 2.53% 2.53%
23 $ 0.05685 $0.06 $0.05 $56.36万 $15.20亿 4.98% 4.98%
24 $ 7.448 $7.79 $7.20 $1,835.31万 $47.31亿 3.11% 3.11%
25 $ 1.1641 $1.19 $1.14 $158.20万 $19.24亿 1.54% 1.54%
26 $ 0.5493 $0.55 $0.53 $16.83万 $17.87亿 3% 3%
27 $ 4140.14 $4,157.34 $4,114.80 $21.22万 $15.77亿 0.23% 0.23%
28 $ 0.7192 $0.73 $0.71 $367.60万 $17.95亿 1.82% 1.82%
29 $ 155.14 $158.45 $149.96 $1,183.58万 $23.76亿 2.85% 2.85%
30 $ 0.00000163 $0.00 $0.00 $1,870.27 $16.30亿 -1.11% -1.11%
31 $ 272.35 $278.50 $266.06 $289.06万 $28.78亿 2.33% 2.33%
32 $ 116.31 $117.09 $113.96 $355.44万 $24.43亿 2.01% 2.01%
33 $ 0.000004614 $0.00 $0.00 $2,513.30万 $19.41亿 8.43% 8.43%
34 $ 8.088 $8.16 $7.79 $27.73万 $12.54亿 3.82% 3.82%
35 $ 5.173 $5.28 $4.72 $5,716.07万 $66.45亿 9.41% 9.41%
36 $ 2.923 $2.97 $2.84 $51.92万 $15.97亿 2.7% 2.7%
37 $ 0.0801 $0.08 $0.08 $51.06万 $6.72亿 3.1% 3.1%
38 $ 0.5795 $0.60 $0.55 $2,557.39万 $15.68亿 4.54% 4.54%
39 $ 1.749 $1.79 $1.72 $6.76万 $8.51亿 1.45% 1.45%
40 $ 0.9988 $1.00 $1.00 $800.27万 $9.82亿 0.04% 0.04%
41 $ 0.20676 $0.21 $0.19 $904.29万 $16.45亿 8.33% 8.33%
42 $ 1.0005 $1.00 $1.00 $1.93万 $8.56亿 0.2% 0.2%
43 $ 0.03817 $0.04 $0.04 $294.61万 $10.34亿 5.99% 5.99%
44 $ 193.57 $202.97 $192.15 $153.92万 $23.37亿 0.23% 0.23%
45 $ 0.11252 $0.12 $0.11 $10.23万 $9.95亿 1.59% 1.59%
46 $ 0.00645 $0.01 $0.01 $10.71万 $5.33亿 1.91% 1.91%
47 $ 0.03472 $0.04 $0.03 $36.97万 $6.63亿 7.79% 7.79%
48 $ 0.82 $0.84 $0.78 $49.25万 $6.16亿 4.96% 4.96%

快讯

更多