Tag: transformers

All the articles with the tag "transformers".

• Trained a Transaction Foundation Model from Scratch on 2×RTX 4090

  5 Jul, 2026

  Trained a 29M-parameter Llama decoder on financial transaction data from scratch on 2×RTX 4090s. Extracted embeddings and got +32% lift on fraud detection with XGBoost. End-to-end pipeline in 18 minutes.

• Inference with My Own Embedding Model

  16 Feb, 2024

  Loading and using a custom-trained sentence embedding model with Hugging Face Transformers.

• Question Generation with Transformers

  10 Nov, 2023

  Exploring question-answering and question-generation pipelines using Hugging Face models.