Llama3-70B as a 7 MB EXE
Posted: Fri May 03, 2024 5:03 amFiveTech Software tech support forums
www.FiveTechSoft.com
https://forums.fivetechsupport.com/
Llama3-70B as a 7 MB EXE
https://forums.fivetechsupport.com/viewtopic.php?f=42&t=44480
Page 1 of 1
Posted: Fri May 03, 2024 5:03 amRe: Llama3-70B as a 7 MB EXE
Posted: Fri May 03, 2024 8:41 amThe idea is to redirect the input and output of hchat.exe so we can use it from Harbour and FWH
Re: Llama3-70B as a 7 MB EXE
Posted: Sat May 04, 2024 4:32 pmAlready working 
It will be included in next FWH build. So your apps can use Llama3-70B power!
https://github.com/FiveTechSoft/screenshots/blob/master/llama370.png?raw=true
It will be included in next FWH build. So your apps can use Llama3-70B power!
https://github.com/FiveTechSoft/screenshots/blob/master/llama370.png?raw=true
Re: Llama3-70B as a 7 MB EXE
Posted: Mon Jun 10, 2024 3:07 amhchat.exe updated:
https://github.com/FiveTechSoft/hchat/blob/main/hchat.exe
To use it from your FWH apps:
1. run this and write your HuggingChat password from FWH\samples:
hchat.exe -u your_email_id_on_huggingface
2. copy hchat.exe hchat.bin
3. buildh.bat llama3.prg (from FWH\samples)
How hchat.exe is built is explained from:
https://github.com/FiveTechSoft/hchat
https://github.com/FiveTechSoft/hchat/blob/main/hchat.exe
To use it from your FWH apps:
1. run this and write your HuggingChat password from FWH\samples:
hchat.exe -u your_email_id_on_huggingface
2. copy hchat.exe hchat.bin
3. buildh.bat llama3.prg (from FWH\samples)
How hchat.exe is built is explained from:
https://github.com/FiveTechSoft/hchat