Llama3-70B as a 7 MB EXE

Llama3-70B as a 7 MB EXE

Postby Antonio Linares » Fri May 03, 2024 5:03 am

regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
 
Posts: 42111
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain

Re: Llama3-70B as a 7 MB EXE

Postby Antonio Linares » Fri May 03, 2024 8:41 am

The idea is to redirect the input and output of hchat.exe so we can use it from Harbour and FWH
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
 
Posts: 42111
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain

Re: Llama3-70B as a 7 MB EXE

Postby Antonio Linares » Sat May 04, 2024 4:32 pm

Already working :-)

It will be included in next FWH build. So your apps can use Llama3-70B power!

https://github.com/FiveTechSoft/screenshots/blob/master/llama370.png?raw=true

Image
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
 
Posts: 42111
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain

Re: Llama3-70B as a 7 MB EXE

Postby Antonio Linares » Mon Jun 10, 2024 3:07 am

hchat.exe updated:
https://github.com/FiveTechSoft/hchat/blob/main/hchat.exe

To use it from your FWH apps:

1. run this and write your HuggingChat password from FWH\samples:
hchat.exe -u your_email_id_on_huggingface

2. copy hchat.exe hchat.bin

3. buildh.bat llama3.prg (from FWH\samples)

How hchat.exe is built is explained from:
https://github.com/FiveTechSoft/hchat
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
 
Posts: 42111
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain


Return to latest AI news

Who is online

Users browsing this forum: No registered users and 1 guest