coinbase
V2EX  ›  OpenAI

GPT4 有多少参数?听说有 1T?

  •  
  •   coinbase · Feb 25, 2024 · 3808 views
    This topic created in 982 days ago, the information mentioned may be changed or developed.
    7 replies  •  2024-02-25 21:04:29 +08:00
    bravecarrot
    bravecarrot
    Feb 25, 2024 via iPhone
    1
    网传有万亿
    VIVIANSNOW
    VIVIANSNOW
    Feb 25, 2024
    2
    话说这 1t 和 万亿都是什么单位呢。也不是一个单位吧
    taotaodaddy
    taotaodaddy
    Feb 25, 2024
    3
    都是 1e+12
    Bapper
    Bapper
    Feb 25, 2024 via iPhone
    4
    @VIVIANSNOW 楼主可能想说一个 trillion (?

    那其实就是万亿
    gaifanking
    gaifanking
    Feb 25, 2024
    5
    billion 级别,比如: https://github.com/THUDM/ChatGLM3 6B 个参数
    liqianyu510
    liqianyu510
    Feb 25, 2024
    6
    据说是 GPT3 的 10 倍,1.8 万亿。但它是 MoE 模型,一般情况下用不到这么多参数
    Myprajna
    Myprajna
    Feb 25, 2024
    7
    蒸馏了一个小版本的出来
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   2192 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 65ms · UTC 16:01 · PVG 00:01 · LAX 08:01 · JFK 11:01
    ♥ Do have faith in what you're doing.