Search found 143 matches: phpbb

Return to advanced search

Re: phpBB to LLM

Edited the first post of this topic with the right instructions:

viewtopic.php?p=266364&sid=34d610603696853e410ee75921e1424b#p266364
by Antonio Linares
Sun Jan 07, 2024 9:28 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

From posts.dbf and posts.fpt now we generate the dataset.json to be trained. We are using just 20 different topics, so the dataset is not too large and we can do quicker tests with it: dataset.prg #include "FiveWin.ch"request dbfcdxfunction Main()    local aPosts := {}, n...
by Antonio Linares
Tue Jan 02, 2024 5:40 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

Here you have run.py to test the model: run.py from transformers import GPT2LMHeadModel, GPT2Tokenizerimport torch# Load the fine-tuned GPT-2 model and tokenizerfine_tuned_model_path = "./fine-tuned-model"model = GPT2LMHeadModel.from_pretrained(fine_tuned_model_path)tokenizer = GPT...
by Antonio Linares
Wed Dec 27, 2023 10:10 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

Dear Anton,

many thanks for your help!

I am reviewing the results :-)
by Antonio Linares
Wed Dec 27, 2023 9:52 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

It's been two days since I've had anything to do with Python! DESKTOP PC with Windows 11 pro: Processor: Intel(R) Core(TM) i9-10920X CPU @ 3.50GHz, 3504 MHz, 12 core(s), 24 logical processor(s) Data carrier: Samsung SSD 970 EVO Plus 1TB 64GB RAM NVIDIA RTX 2080TI First attempt, without GPU support (...
by alerchster
Wed Dec 27, 2023 8:33 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

Dear Anton,

many thanks for your so valuable feedback!
by Antonio Linares
Tue Dec 26, 2023 7:16 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

Hello Antonio, From the looks of it, the training doesn't just happen in one round: First round generated a 715MB file "cached_lm_GPT2Tokenizer_128_fivetech_forums_20231222.sql" in 16min. The second round is actually the training and I'm now at 0% after 47 minutes and the open duration is ...
by alerchster
Tue Dec 26, 2023 6:32 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

Dear Anton,

> result: ready in 16min maybe with some errors - error messages can't be saved there!

Can you please send me te generated "fine-tuned-model" files using wormhole app ?

https://wormhole.app/

many thanks!
by Antonio Linares
Tue Dec 26, 2023 12:09 am
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

installed python 3.11.7
pip install torch
pip install transformers

python train.py

result: ready in 16min maybe with some errors - error messages can't be saved there!

if i run train.py again then comes terrible | 213/1628301 [05:57<1293:44:33, 2.86s/it]

can't wait so long :(
by alerchster
Mon Dec 25, 2023 8:04 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

I think i should downgrade python to 3.11 https://stackoverflow.com/questions/77225812/is-there-a-way-to-install-pytorch-on-python-3-12-0 here is the output with conda ... C:\fwh\AI>conda install pytorch==1.10.0 torchvision==0.11.2 torchaudio==0.10.0 -c pytorch Channels: - pytorch - defau...
by alerchster
Mon Dec 25, 2023 7:11 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

python is 3.12 pip is uptodate antivirus is stopped ? C:\fwh\AI>pip install pytorch Collecting pytorch Using cached pytorch-1.0.2.tar.gz (689 bytes) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Building wheels for...
by alerchster
Mon Dec 25, 2023 6:42 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

If you're encountering issues with installing PyTorch using pip install torch, it could be due to several reasons. Here are a few steps you can take to resolve the issue: Check Python Version: Ensure that you are using a compatible version of Python. PyTorch may have specific requirements for the P...
by Antonio Linares
Mon Dec 25, 2023 6:21 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

C:\fwh\AI>pip install torch
ERROR: Could not find a version that satisfies the requirement torch (from versions: none)
ERROR: No matching distribution found for torch

C:\fwh\AI>
by alerchster
Mon Dec 25, 2023 6:13 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

run this:

pip install torch

and then please try it again
by Antonio Linares
Mon Dec 25, 2023 6:06 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898

Re: phpBB to LLM

========================== RESTART: C:\fwh\AI\train.py =========================
Traceback (most recent call last):
File "C:\fwh\AI\train.py", line 1, in <module>
import torch
ModuleNotFoundError: No module named 'torch'
by alerchster
Mon Dec 25, 2023 6:04 pm
 
Forum: FiveWin for Harbour/xHarbour
Topic: phpBB to LLM
Replies: 33
Views: 3898
Next

Return to advanced search