Llama3-70B as a 7 MB EXE

Post Reply
User avatar
Antonio Linares
Site Admin
Posts: 42268
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Contact:

Llama3-70B as a 7 MB EXE

Post by Antonio Linares »

regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
Posts: 42268
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Contact:

Re: Llama3-70B as a 7 MB EXE

Post by Antonio Linares »

The idea is to redirect the input and output of hchat.exe so we can use it from Harbour and FWH
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
Posts: 42268
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Contact:

Re: Llama3-70B as a 7 MB EXE

Post by Antonio Linares »

Already working :-)

It will be included in next FWH build. So your apps can use Llama3-70B power!

https://github.com/FiveTechSoft/screens ... g?raw=true

Image
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
Posts: 42268
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Contact:

Re: Llama3-70B as a 7 MB EXE

Post by Antonio Linares »

hchat.exe updated:
https://github.com/FiveTechSoft/hchat/b ... /hchat.exe

To use it from your FWH apps:

1. run this and write your HuggingChat password from FWH\samples:
hchat.exe -u your_email_id_on_huggingface

2. copy hchat.exe hchat.bin

3. buildh.bat llama3.prg (from FWH\samples)

How hchat.exe is built is explained from:
https://github.com/FiveTechSoft/hchat
regards, saludos

Antonio Linares
www.fivetechsoft.com
Post Reply