NPU (Neural processing units) are special processors to run neural networks (AI). Layla implements Qualcomm AI Engine to offload Stable Diffusion models to their dedicated hardware called the HTP (Hexagon Tensor Processor):
generates an image in ~10 seconds!
negligible RAM usage
low power consumption
You can find these models in the same area as the image generation feature in Layla (the Stable Diffusion mini-app): https://www.layla-network.ai/post/how-to-enable-image-generation-in-layla
Look for image models with the Qualcomm NPU logo at the top right corner (you can also filter by "qnn" in the model list):
Layla offers 4 NPU models which are all very popular stable diffusion models. (More can be added upon request!)
Note, all the images shown in the screenshot above are generated on a mobile phone, completely offline, using the NPU!
NPU models can only be run on Qualcomm chipsets: Snapdragon Gen 2 and 3
Comments