ComfyUI-StableAudioSampler
Preview:
Introduce:
Comfyui-stableaudiosampler is an Audio sampler plug-in integrated in the ComfyUI node that allows users to generate audio and output raw bytes and sample rates, supports all raw StableAudio Open parameters, and can save audio to a file. This plugin is open source and is actively being developed to provide an easy-to-use and powerful tool for music makers.
https://pic.chinaz.com/ai/2024/06/24060609014844058731.jpg
Stakeholders:
Music producers and audio engineers can use the ComfyUI-StableAudioSampler to create unique music rhythms and sound effects, providing an intuitive interface and powerful features to make the music creation process smoother and more creative.
Usage Scenario Examples:
- Music producers use this plugin to generate unique rhythms and melodies
- Audio engineers use it to create background music for movies or games
- Educators use the tool to teach students in music production classes
The features of the tool:
- Load the audio using the HuggingFace model
- Generates audio and outputs raw bytes and sample rate
- Contains all the original Stable Audio Olien parameters
- Supports saving audio to a file
- Plans to add more sampler node options such as gain control and clipping
- Supports audio formats compatible with other audio node packages
- Code refactoring is under way to improve stability and performance
Steps for Use:
- 1. Make sure that the HF_TOKEN environment variable is set, as model loading cannot be done directly from the saved file yet.
- 2. Download the required Stable Audio Olien model from HuggingFace.
- 3. Place the downloaded model in the appropriate directory so that the plug-in can load.
- 4. Open ComfyUI and load the ComfYUi-StableAudiosamliler plugin.
- 5. Set plug-in parameters, such as audio output format and sampling rate, as required.
- 6. Use the plugin to generate audio and save it to the specified file.
- 7. If you encounter problems, you can review the plug-in documentation or submit a problem report on GitHub.
Tool’s Tabs: Audio processing, music production