A Framework of Small-scale Large Multimodal Models

A CLI to manage install and configure llama inference implemenation in multiple languages

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

This application allows users to upload PDF files, process them, and ask questions about the content using a locally hosted language model. The system uses Retrieval-Augmented Generation (RAG) to provide accurate answers based on the uploaded PDFs.

A real-time offline voice-to-voice AI assistant built for Raspberry Pi

Most simple and minimal code to run an LLM chatbot from HuggingFace hub with OpenVINO

An offline AI-powered chatbot built using Streamlit and TinyLlama. It responds to your messages in real-time without needing internet access. Great for experimenting with lightweight local language models.

Reproduction and exploration of QBB-based low-bit LLM quantization on TinyLlama, with 2-bit/4-bit experiments and WikiText-2 PPL evaluation.

Educational research demonstrating weight manipulation attacks in SafeTensors models. Proves format validation alone is insufficient for AI model security.

This project is a chat application with a web interface developed using Streamlit and a backend developed with FastAPI. Use LLM TinyLlama Model as chat assistant.

Terminal Commander AI is a smart, natural language terminal assistant that converts English instructions into safe, executable shell commands. It supports ROS operations, multi-terminal launching, command explanations, and history — powered by a local TinyLlama LLM.

📲 Create a local LLM server on Android using Python and llama.cpp for easy access to language models.

Chhota Bhaijaan - A Salman Khan Chatbot Powered by TinyLlama

A lightweight local chatbot built with llama.cpp and Gradio. Supports TinyLlama, Mistral, and DeepSeek-Qwen models that can be switched during chat with full offline inference and chat history management.

⚡ Enterprise-ready federated learning for LLMs. On-device personalization, privacy-preserving aggregation, LoRA adapters, real-time dashboard. Perfect for privacy-sensitive AI applications. 🌟🏆

Sophisticated multi-agent system combining natural language processing with ROS integration and scientific analysis using optimized open-source LLMs.

This project is a Multi-Agent AI System that assists farmers by providing AI-driven crop recommendations, market analysis, and real-time weather insights by the use of Ollama AI, WeatherAPI, and SQLite3, it optimizes resource usage, reduces costs, and maximizes profits—ensuring sustainable and data-driven agriculture.

PecanAi-X1: a free, lightweight 1.1B AI model for document Q&A. Runs locally on CPU via Ollama. Built by merging two TinyLlama models + LoRA fine-tune + RAG.

A simple chat application build with flet and tinyllama model

An AI-powered document assistant that lets you "chat" with your PDFs using Retrieval-Augmented Generation (RAG) and local LLMs