{"id":11696,"date":"2024-01-11T01:41:58","date_gmt":"2024-01-10T16:41:58","guid":{"rendered":"https:\/\/www.webcyou.com\/?p=11696"},"modified":"2024-01-11T01:42:07","modified_gmt":"2024-01-10T16:42:07","slug":"llama%e3%83%a2%e3%83%87%e3%83%ab-ggml%e3%83%95%e3%82%a9%e3%83%bc%e3%83%9e%e3%83%83%e3%83%88%ef%bc%88llama-cpp%ef%bc%89%e3%82%92rust%e3%83%95%e3%83%ac%e3%83%bc%e3%83%a0%e3%83%af%e3%83%bc%e3%82%af-lepto","status":"publish","type":"post","link":"https:\/\/www.webcyou.com\/?p=11696","title":{"rendered":"LLaMA\u30e2\u30c7\u30eb GGML\u30d5\u30a9\u30fc\u30de\u30c3\u30c8\uff08llama.cpp\uff09\u3092Rust\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af Leptos\u3092\u7528\u3044\u3066 M1MacMini\u3067\u30b5\u30af\u30c3\u3068\u52d5\u304b\u3059\u3002"},"content":{"rendered":"\n

\u3069\u3082\u3067\u3059\u3002<\/p>\n

\u30bf\u30a4\u30c8\u30eb\u60a9\u307f\u307e\u3057\u305f\u3002<\/p>\n

\u4eca\u56de\u306f\u3001Rust\u306e\u30d5\u30eb\u30b9\u30bf\u30c3\u30af\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af \u300cLeptos<\/a>\u300d\u7528\u3044\u3066\u3001Meta\u793e\u304c\u958b\u767a\u3057\u305f\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\uff08LLM\uff09LLaMA\u306eGGML\u30d5\u30a9\u30fc\u30de\u30c3\u30c8\uff08llama.cpp\uff09\u3092\u3001M1 MacMini\u306e\u30ed\u30fc\u30ab\u30eb\u74b0\u5883\u3067\u52d5\u304b\u305d\u3046\u3068\u3044\u3063\u305f\u3068\u3053\u308d\u306b\u306a\u308a\u307e\u3059\u3002\uff08\u9577\u3044\uff09<\/p>\n

\"\"<\/a><\/p>\n

\u4e00\u304b\u3089\u4f5c\u6210\u3059\u308b\u308f\u3051\u3067\u306f\u306a\u304f\u3001\u65e2\u306b\u4f5c\u6210\u3055\u308c\u305f\u65b9\u304cGitHub\u306b\u30a2\u30c3\u30d7\u3055\u308c\u3066\u3044\u307e\u3059\u306e\u3067\u305d\u3061\u3089\u3092\u6271\u3063\u3066\u3044\u3053\u3046\u3068\u3044\u3063\u305f\u611f\u3058\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n

\u305d\u306e\u30ec\u30dd\u30b8\u30c8\u30ea\u306f\u3053\u3061\u3089\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n

MoonKraken\/rusty_llama<\/a><\/p>\n

\u306a\u306e\u3067\u3001\u6bd4\u8f03\u7684\u30b5\u30af\u30c3\u3068\u52d5\u304b\u305b\u308b\u304b\u306a\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n

\u00a0<\/p>\n

\u6e96\u5099<\/h4>\n

\u307e\u305a\u306f\u3001\u6e96\u5099\u3068\u3057\u3066Rust\u306etool\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u3044\u304d\u307e\u3059\u3002<\/p>\n

rustup toolchain install nightly\nrustup target add wasm32-unknown-unknown\ncargo install trunk cargo-leptos<\/pre>\n
\u5b8c\u4e86\u3057\u307e\u3057\u305f\u3089\u3001\u30ec\u30dd\u30b8\u30c8\u30ea\u3092git clone\u3002<\/p>\n
git clone git@github.com:MoonKraken\/rusty_llama.git<\/pre>\n
\u3053\u3061\u3089\u306e\u30bd\u30fc\u30b9\u3067\u3059\u304c\u3001CSS\u306bTailwindCSS\u3092\u4f7f\u7528\u3057\u3066\u3044\u307e\u3059\u306e\u3067\u3001TailwindCSS\u306enode\u30e2\u30b8\u30e5\u30fc\u30eb\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u307e\u3059\u3002<\/p>\n
npm install -D tailwindcss<\/pre>\n
css\u3092\u51fa\u529b\u3057\u306a\u3044\u3068\u3044\u3051\u306a\u3044\u306e\u3067\u3001\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u306e\u30eb\u30fc\u30c8\u306b\u3066\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3067css\u3092\u51fa\u529b\u3057\u307e\u3059\u3002<\/p>\n
npx tailwindcss -i .\/input.css -o .\/style\/output.css --watch<\/pre>\n
\u00a0<\/p>\n
\u30e2\u30c7\u30eb\u306e\u6e96\u5099<\/h5>\n
\u4f7f\u7528\u3059\u308b\u30e2\u30c7\u30eb\u3001LLaMA\u306eGGML\u30d5\u30a9\u30fc\u30de\u30c3\u30c8\uff08llama.cpp\uff09\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u307e\u3059\u3002<\/p>\n
\u4eca\u56de\u306f\u3001Wizard-Vicuna-7B-Uncensored.ggmlv3.q4_K_S.bin\u3092\u4f7f\u7528\u3057\u307e\u3057\u305f\u3002<\/span><\/p>\n
\u3053\u3061\u3089<\/a>\u304b\u3089\u4f7f\u7528\u3059\u308b\u30e2\u30c7\u30eb\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u307e\u3059\u3002<\/p>\n
\u5bfe\u8c61\u306e\u30e2\u30c7\u30eb\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9<\/strong><\/p>\n
\"\"<\/a><\/p>\n
\u00a0<\/p>\n
Leptos\u5074\u3067\u3001\u30e2\u30c7\u30eb\u306eimport\u304c\u5fc5\u8981\u3068\u306a\u308b\u306e\u3067\u300c.env\u300d\u30d5\u30a1\u30a4\u30eb\u306eMODEL_PATH\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u305f\u30e2\u30c7\u30eb\u306e\u30d1\u30b9\u306b\u5909\u66f4\u3057\u307e\u3059\u3002\u8a72\u5f53\u30d5\u30a1\u30a4\u30eb\u306f\u3053\u3061\u3089<\/a>\u3002<\/span><\/p>\n
\u305d\u308c\u3067\u306f\u6e96\u5099\u304c\u5b8c\u4e86\u3057\u307e\u3057\u305f\u306e\u3067\u8d77\u52d5\u3002<\/p>\n
\u00a0<\/p>\n
\u8d77\u52d5<\/h4>\n
\u305d\u308c\u3067\u306f\u8d77\u52d5\u3002<\/p>\n
cargo leptos watch<\/pre>\n
http:\/\/localhost:3000\/ <\/a>\u3092\u958b\u3044\u3066\u3001\u30d7\u30ed\u30f3\u30d7\u30c8\u5165\u529b\u753b\u9762\u304c\u8868\u793a\u3057\u305f\u3089\u512a\u52dd\u3067\u3059\u3002<\/p>\n
\"\"<\/p>\n
\u5b9f\u884c\u3057\u305f\u74b0\u5883\u306f\u3001M1 MacMini\u3067\u3057\u305f\u304c\u3001\u7d50\u69cb\u30b5\u30af\u30b5\u30af\u306b\u8fd4\u4fe1\u3082\u8fd4\u3063\u3066\u304d\u3066\u826f\u3044\u611f\u3058\u3067\u3057\u305f\u3002<\/p>\n
\u65e5\u672c\u8a9e\u3082\u3044\u3051\u305d\u3046\u306a\u69d8\u5b50\u3060\u3063\u305f\u306e\u3067\u65e5\u672c\u8a9e\u89e3\u8aac\u3092\u6c42\u3081\u305f\u306e\u3067\u3059\u304c\u3001\u5f53\u305f\u308a\u524d\u3067\u3059\u304c\u7cbe\u5ea6\u306f\u826f\u304f\u306a\u3044\u69d8\u5b50\u3067\u3057\u305f\u3002<\/p>\n
\"\"<\/p>\n
\u5b9f\u88c5\u65b9\u6cd5\u3068\u5171\u306b\u3001\u30b3\u30fc\u30c9\u306e\u89e3\u8aac\u3082youtube\u306b\u4e0a\u304c\u3063\u3066\u306f\u3044\u307e\u3059\u304c\u3001GitHub\u306b\u3042\u304c\u3063\u3066\u3044\u308b\u30bd\u30fc\u30b9\u3068\u304b\u306a\u308a\u7570\u306a\u308a\u305d\u306e\u307e\u307e\u4f5c\u6210\u3057\u3066\u3082\u8d77\u52d5\u3057\u307e\u305b\u3093\u3002\u89e3\u8aac\u3068\u3057\u3066\u898b\u3066\u9802\u304f\u5f62\u304c\u826f\u3044\u304b\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n