Home Sign Up Sign In
Advertisement
lyang

请教， torchrun 多卡启动大模型，可以用 fastapi 调用吗

  •   
  •   lyang · May 17, 2024 · 1286 views
    This topic created in 834 days ago, the information mentioned may be changed or developed.

    如题，可以把 fastapi 写进代码里面，torchrun 调用吗

    还是通过 torchrun 读取数据库接口等信息，fastapi 写入数据库读取结果

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   3000 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 20ms · UTC 08:53 · PVG 16:53 · LAX 01:53 · JFK 04:53
    ♥ Do have faith in what you're doing.