Wasi-nn example in Async mode

[alanpoon]

Is there async mode example for wasi-nn? I am unable to add wasi-nn plugin to wasmedge_sdk async WasiCtx.

[juntao]

Perhaps you could try our new SDK api here? It fixes a number of potential async issues.

WasmEdge/wasmedge-rust-sdk#83

[alanpoon]

I tried.

let module = Module::from_file(Some(&config), wasm_file)?;
    PluginManager::load(None)?;
    PluginManager::nn_preload(vec![NNPreload::from_str("default:GGML:AUTO:tinyllama-1.1b-chat-v0.3.Q5_K_M.gguf").unwrap()]);
    let nn = PluginManager::load_plugin_wasi_nn()?;
    
    let mut instance_map = HashMap::new();
    instance_map.insert(wasi_module.name().to_string(), wasi_module.as_mut());

nn is the wasmedge_sys::instance, while instance_map's value is of type AsyncImportObject.

I am supposed to add "nn" into the hashMap.
How do I convert the type wasmedge_sys::Instance into AsynImportObject?

[hydai]

@apepkuss
Is it possible to use any plugin in the async wasi?
It looks like the Instance and AsyncImportObject are totally different objects.
If so, could we have an example to use AysnWASI with a normal plugin?

[apepkuss]

@hydai As I know, the current implementation of async-wasi does not have a relevant design for supporting plugins.

@L-jasmine Could you please check if the async-wasi could provide support for our plugins, like wasi-nn plugin? Thanks!