Updating crates.io index Installing shimmy v1.7.0 Updating crates.io index Locking 290 packages to latest compatible versions Adding axum v0.7.9 (available: v0.8.6) Adding dirs v5.0.1 (available: v6.0.0) Adding rand v0.8.5 (available: v0.9.2) Adding reqwest v0.11.27 (available: v0.12.23) Adding safetensors v0.4.5 (available: v0.6.2) Adding sysinfo v0.30.13 (available: v0.37.2) Adding thiserror v1.0.69 (available: v2.0.17) Compiling proc-macro2 v1.0.101 Compiling unicode-ident v1.0.19 Compiling quote v1.0.41 Compiling libc v0.2.177 Compiling cfg-if v1.0.3 Compiling shlex v1.3.0 Compiling bytes v1.10.1 Compiling find-msvc-tools v0.1.3 Compiling pin-project-lite v0.2.16 Compiling itoa v1.0.15 Compiling futures-core v0.3.31 Compiling fnv v1.0.7 Compiling log v0.4.28 Compiling stable_deref_trait v1.2.1 Compiling once_cell v1.21.3 Compiling serde_core v1.0.228 Compiling pin-utils v0.1.0 Compiling smallvec v1.15.1 Compiling serde v1.0.228 Compiling httparse v1.10.1 Compiling glob v0.3.3 Compiling version_check v0.9.5 Compiling typenum v1.19.0 Compiling futures-sink v0.3.31 Compiling futures-task v0.3.31 Compiling slab v0.4.11 Compiling tracing-core v0.1.34 Compiling zerocopy v0.8.27 Compiling litemap v0.8.0 Compiling writeable v0.6.1 Compiling prettyplease v0.2.37 Compiling crossbeam-utils v0.8.21 Compiling memchr v2.7.6 Compiling generic-array v0.14.7 Compiling regex-syntax v0.8.6 Compiling clang-sys v1.8.1 Compiling minimal-lexical v0.2.1 Compiling tower-service v0.3.3 Compiling icu_normalizer_data v2.0.0 Compiling http v1.3.1 Compiling icu_properties_data v2.0.1 Compiling untrusted v0.9.0 Compiling libloading v0.8.9 Compiling futures-channel v0.3.31 Compiling either v1.15.0 Compiling thiserror v1.0.69 Compiling httpdate v1.0.3 Compiling bindgen v0.72.1 Compiling nom v7.1.3 Compiling itertools v0.13.0 Compiling http v0.2.12 Compiling rustls v0.21.12 Compiling hashbrown v0.16.0 Compiling syn v2.0.106 Compiling serde_json v1.0.145 Compiling equivalent v1.0.2 Compiling jobserver v0.1.34 Compiling ryu v1.0.20 Compiling http-body v1.0.1 Compiling cc v1.2.40 Compiling percent-encoding v2.3.2 Compiling getrandom v0.2.16 Compiling signal-hook-registry v1.4.6 Compiling socket2 v0.6.0 Compiling mio v1.0.4 Compiling block-buffer v0.10.4 Compiling crypto-common v0.1.6 Compiling rand_core v0.6.4 Compiling same-file v1.0.6 Compiling bitflags v2.9.4 Compiling regex-automata v0.4.11 Compiling rustc-hash v2.1.1 Compiling walkdir v2.5.0 Compiling digest v0.10.7 Compiling indexmap v2.11.4 Compiling form_urlencoded v1.2.2 Compiling crossbeam-epoch v0.9.18 Compiling find_cuda_helper v0.2.0 Compiling getrandom v0.3.3 Compiling try-lock v0.2.5 Compiling ppv-lite86 v0.2.21 Compiling rayon-core v1.13.0 Compiling rustversion v1.0.22 Compiling cpufeatures v0.2.17 Compiling cmake v0.1.54 Compiling autocfg v1.5.0 Compiling utf8parse v0.2.2 Compiling anstyle-parse v0.2.7 Compiling sha1 v0.10.6 Compiling crossbeam-deque v0.8.6 Compiling rand_chacha v0.3.1 Compiling want v0.3.1 Compiling http-body v0.4.6 Compiling socket2 v0.5.10 Compiling byteorder v1.5.0 Compiling is_terminal_polyfill v1.70.1 Compiling cexpr v0.6.0 Compiling num-traits v0.2.19 Compiling data-encoding v2.9.0 Compiling colorchoice v1.0.4 Compiling rand v0.8.5 Compiling anstyle v1.0.13 Compiling rustix v1.1.2 Compiling utf-8 v0.7.6 Compiling atomic-waker v1.1.2 Compiling mime v0.3.17 Compiling utf8_iter v1.0.4 Compiling anstyle-query v1.1.4 Compiling ring v0.17.14 Compiling sys-info v0.9.1 Compiling parking_lot_core v0.9.12 Compiling sync_wrapper v1.0.2 Compiling tower-layer v0.3.3 Compiling anstream v0.6.21 Compiling http-body-util v0.1.3 Compiling scopeguard v1.2.0 Compiling lazy_static v1.5.0 Compiling option-ext v0.2.0 Compiling base64 v0.21.7 Compiling strsim v0.11.1 Compiling heck v0.5.0 Compiling linux-raw-sys v0.11.0 Compiling clap_lex v0.7.5 Compiling anyhow v1.0.100 Compiling regex v1.11.3 Compiling clap_builder v4.5.48 Compiling rustls-pemfile v1.0.4 Compiling rayon v1.11.0 Compiling dirs-sys v0.4.1 Compiling lock_api v0.4.14 Compiling sharded-slab v0.1.7 Compiling serde_path_to_error v0.1.20 Compiling tracing-log v0.2.0 Compiling thread_local v1.1.9 Compiling encoding_rs v0.8.35 Compiling self_cell v1.2.0 Compiling webpki-roots v0.25.4 Compiling memo-map v0.3.3 Compiling fastrand v2.3.0 Compiling nu-ansi-term v0.50.1 Compiling base64 v0.22.1 Compiling iana-time-zone v0.1.64 Compiling matchit v0.7.3 Compiling ipnet v2.11.0 Compiling sync_wrapper v0.1.2 Compiling shimmy v1.7.0 Compiling parking_lot v0.12.5 Compiling dirs v5.0.1 Compiling memmap2 v0.9.8 Compiling synstructure v0.13.2 Compiling tempfile v3.23.0 Compiling zerofrom-derive v0.1.6 Compiling yoke-derive v0.8.0 Compiling tokio-macros v2.5.0 Compiling zerovec-derive v0.11.1 Compiling displaydoc v0.2.5 Compiling tracing-attributes v0.1.30 Compiling serde_derive v1.0.228 Compiling futures-macro v0.3.31 Compiling thiserror-impl v1.0.69 Compiling async-trait v0.1.89 Compiling enumflags2_derive v0.7.12 Compiling tokio v1.47.1 Compiling clap_derive v4.5.47 Compiling futures-util v0.3.31 Compiling matchers v0.2.0 Compiling sysinfo v0.30.13 Compiling enumflags2 v0.7.12 Compiling zerofrom v0.1.6 Compiling yoke v0.8.0 Compiling tracing v0.1.41 Compiling tungstenite v0.24.0 Compiling zerovec v0.11.4 Compiling zerotrie v0.2.2 Compiling tracing-subscriber v0.3.20 Compiling clap v4.5.48 Compiling tinystr v0.8.1 Compiling potential_utf v0.1.3 Compiling icu_collections v2.0.0 Compiling icu_locale_core v2.0.0 Compiling rustls-webpki v0.101.7 Compiling sct v0.7.1 Compiling serde_urlencoded v0.7.1 Compiling uuid v1.18.1 Compiling chrono v0.4.42 Compiling minijinja v2.12.0 Compiling safetensors v0.4.5 Compiling icu_provider v2.0.0 Compiling axum-core v0.4.5 Compiling icu_properties v2.0.1 Compiling icu_normalizer v2.0.0 Compiling idna_adapter v1.2.1 Compiling idna v1.1.0 Compiling url v2.5.7 Compiling tokio-util v0.7.16 Compiling hyper v1.7.0 Compiling tokio-tungstenite v0.24.0 Compiling tower v0.5.2 Compiling tokio-stream v0.1.17 Compiling llama-cpp-sys-2 v0.1.122 Compiling tokio-rustls v0.24.1 Compiling h2 v0.3.27 Compiling hyper-util v0.1.17 Compiling axum v0.7.9 Compiling hyper v0.14.32 Compiling hyper-rustls v0.24.2 Compiling reqwest v0.11.27 Compiling llama-cpp-2 v0.1.122 error: couldn't read `/home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/../templates/docker/Dockerfile`: No such file or directory (os error 2) --> /home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/templates.rs:80:30 | 80 | let dockerfile_content = include_str!("../templates/docker/Dockerfile"); | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ error: couldn't read `/home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/../templates/docker/Dockerfile`: No such file or directory (os error 2) --> /home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/templates.rs:156:30 | 156 | let dockerfile_content = include_str!("../templates/docker/Dockerfile"); | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ error: couldn't read `/home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/../templates/docker/Dockerfile`: No such file or directory (os error 2) --> /home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/templates.rs:176:30 | 176 | let dockerfile_content = include_str!("../templates/docker/Dockerfile"); | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ error: couldn't read `/home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/../templates/frameworks/fastapi/main.py`: No such file or directory (os error 2) --> /home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/templates.rs:190:24 | 190 | let main_content = include_str!("../templates/frameworks/fastapi/main.py"); | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ error[E0599]: no method named `with_n_cpu_moe` found for struct `LlamaModelParams` in the current scope --> /home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/engine/llama.rs:229:45 | 229 | model_params = model_params.with_n_cpu_moe(n); | ^^^^^^^^^^^^^^ method not found in `LlamaModelParams` error[E0599]: no method named `with_cpu_moe_all` found for struct `LlamaModelParams` in the current scope --> /home/boxer/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/shimmy-1.7.0/src/engine/llama.rs:232:45 | 232 | model_params = model_params.with_cpu_moe_all(); | ^^^^^^^^^^^^^^^^ method not found in `LlamaModelParams` For more information about this error, try `rustc --explain E0599`. warning: shimmy@1.7.0: Building shimmy version 1.7.0 error: could not compile `shimmy` (lib) due to 6 previous errors error: failed to compile `shimmy v1.7.0`, intermediate artifacts can be found at `/tmp/cargo-installTFBOuk`. To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.