Page 2 of 2

Re: Using free AI power from our Harbour apps !!!

Posted: Mon Apr 03, 2023 6:06 am
by Antonio Linares
Dear Anser,

It must be a 64 bits EXE only thats why we prefer to use MSVC

The process to create is a 64 bits process, thats why our app must be a 64 bits one

Re: Using free AI power from our Harbour apps !!!

Posted: Mon Apr 03, 2023 10:25 am
by Antonio Linares
Look how simple is the new code of gpt4all.prg: You can query the oAI without user intervention too :-)

Code: Select all | Expand

#include "hbclass.ch"
#include "FileIO.ch"

function Main()

   local dummy := QOut( "Loading GPT4All... cpu speed: " + AllTrim( CPUSpeed() ),;
                        If( ! CpuHasAvx2(), "not", "" ) + " AVX2 support. Type exit to finish" )
   local oAI := GPT4All():New(), cMsg

   oAI:Read()
   while ! Empty( cMsg := oAI:Input() ) 
      if cMsg != "exit"
         oAI:Write( cMsg )
         oAI:Read()
      else
         exit
      end      
   end   

   oAI:End()

return nil  

Re: Using free AI power from our Harbour apps !!!

Posted: Wed Apr 05, 2023 3:46 pm
by Antonio Linares
A faster version named "vicuna" is already available:

Download the EXE from here, select the one that matches your CPU AVX, AVX2 or AVX512:
https://github.com/ggerganov/llama.cpp/releases

Download the data from here:
https://huggingface.co/eachadea/ggml-vi ... b-4bit.bin

Create this run.bat to execute it:

Code: Select all | Expand

title llama.cpp
:start
main -i --interactive-first -r "### Human:" -t 8 --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m models/llama-7B/ggml-vicuna-13b-4bit.bin
pause
goto start

Re: Using free AI power from our Harbour apps !!!

Posted: Sat Apr 08, 2023 10:07 am
by Ari
Hello Antonio

Congratulations ! :D


Does it run on mod_harbour :?:

Re: Using free AI power from our Harbour apps !!!

Posted: Sat Apr 08, 2023 1:39 pm
by Otto
Hello Antonio,
I use ChatGPT a lot as a kind of lexicon.
But I can't imagine what exactly AI could do starting inside my programme.
Does you have practical examples of use?

Best regards,
Otto

Re: Using free AI power from our Harbour apps !!!

Posted: Sat Apr 08, 2023 9:00 pm
by Antonio Linares
Dear Otto,

There is a new revolution named AutoGPT: (automatic prompting)
https://github.com/Torantulino/Auto-GPT

It is __literally__ mind blowing :-)

look for autoGPT in youtube... get prepared for the BIG revolution!

This is evolving every day! :-)