Re: Using free AI power from our Harbour apps !!!
Posted:
Wed Apr 05, 2023 3:46 pmby Antonio Linares
A faster version named "vicuna" is already available:
Download the EXE from here, select the one that matches your CPU AVX, AVX2 or AVX512:
https://github.com/ggerganov/llama.cpp/releasesDownload the data from here:
https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/resolve/main/ggml-vicuna-13b-4bit.binCreate this run.bat to execute it:
- Code: Select all Expand view
title llama.cpp
:start
main -i --interactive-first -r "### Human:" -t 8 --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m models/llama-7B/ggml-vicuna-13b-4bit.bin
pause
goto start
Re: Using free AI power from our Harbour apps !!!
Posted:
Sat Apr 08, 2023 10:07 amby Ari
Hello Antonio
Congratulations !
Does it run on mod_harbour
Re: Using free AI power from our Harbour apps !!!
Posted:
Sat Apr 08, 2023 1:39 pmby Otto
Hello Antonio,
I use ChatGPT a lot as a kind of lexicon.
But I can't imagine what exactly AI could do starting inside my programme.
Does you have practical examples of use?
Best regards,
Otto
Re: Using free AI power from our Harbour apps !!!
Posted:
Sat Apr 08, 2023 9:00 pmby Antonio Linares
Dear Otto,
There is a new revolution named AutoGPT: (automatic prompting)
https://github.com/Torantulino/Auto-GPTIt is __literally__ mind blowing
look for autoGPT in youtube... get prepared for the BIG revolution!
This is evolving every day!
Re: Using free AI power from our Harbour apps !!!
Posted:
Sun Apr 09, 2023 6:43 amby Antonio Linares
A powershell script to install and run vicuna:
https://github.com/mps256/vicuna.ps1
Re: Using free AI power from our Harbour apps !!!
Posted:
Sun Apr 09, 2023 6:44 amby Antonio Linares
Ari wrote:Hello Antonio
Congratulations !
Does it run on mod_harbour
Dear Ari,
This is changing everyday, so fast. Yes, it should work with mod_harbour fine too. We have not tested it yet