Mine Context is a proactive, context-aware desktop partner that captures screenshots and on-screen content to surface insights, summaries, and todos. It supports multimodal context, local-first storage, and OpenAI-compatible or Doubao model backends.
Built with Electron, React, and TypeScript, it offers profiles, automation intervals, token usage dashboards, and backend debugging at localhost:1733. Users supply their own API key and can run local or custom model endpoints.
Use Cases:
An open-source, proactive context-aware AI partner, dedicated to bringing clarity and efficiency to your work, study and creation.
中文 / English
Community Best Practice · Report Issues · Feedback
[![][release-shield]][release-link]
[![][github-stars-shield]][github-stars-link]
[![][github-issues-shield]][github-issues-shield-link]
[![][github-contributors-shield]][github-contributors-link]
[![][license-shield]][license-shield-link]
[![][last-commit-shield]][last-commit-shield-link]
[![][wechat-shield]][wechat-shield-link]
👋 Join our WeChat / Lark / Red Note Group (https://bytedance.larkoffice.com/wiki/Hg6VwrxnTiXtWUkgHexcFTqrnpg)
🌍 Join our Discord Group (https://discord.gg/tGj7RQ3nUR)
🖥️ Download for Mac · 💻 Download for Windows
Table of Contents
MineContext is a proactive context-aware AI partner. By utilizing screenshots and content comprehension (with future support for multi-source multimodal information including documents, images, videos, code, and external application data), it can see and understand the user's digital world context. Based on an underlying contextual engineering framework, it actively delivers high-quality information such as insights, daily/weekly summaries, to-do lists, and activity records.
!feature.gif
MineContext focuses on four key features: effortless collection, intelligent resurfacing, proactive delivery, and a context engineering architecture.
MineContext places a high priority on user privacy. By default, all data is stored locally in the following path to ensure your privacy and security.
~/Library/Application Support/MineContext/Data
In addition, we support custom model services based on the OpenAI API protocol. You can use fully local models in MineContext, ensuring that any data does not leave your local environment.
Click Github Latest Release (https://github.com/volcengine/MineContext/releases) to Download
!Download APP
Note: Starting from v0.1.5, MineContext supports Apple notarization, so you no longer need to disable the quarantine attribute. If you're using an older version, please refer to the previous documentation (https://github.com/volcengine/MineContext/blob/0.1.4/README.md) for instructions.
After the application launches, please follow the prompts to enter your API key. (Note: On the first run, the application needs to install the backend environment, which may take about two minutes).
We currently support services from Doubao, OpenAI, and custom models. This includes any local models or third-party model services that are compatible with the OpenAI API format.
We recommend using LMStudio (https://lmstudio.ai/) to run local models. It provides a simple interface and powerful features to help you quickly deploy and manage them.
Considering both cost and performance, we recommend using the Doubao model. The Doubao API Key can be generated in the API Management Interface (https://console.volcengine.com/ark/region:ark+cn-beijing/apiKey).
After obtaining the Doubao API Key, you need to activate two models in the Model Activation Management Interface (https://console.volcengine.com/ark/region:ark+cn-beijing/model): the Visual Language Model and the Embedding Model.
Visual Language Model: Doubao-Seed-1.6-flash !doubao-vlm-model
Embedding Model: Doubao-embedding-large !doubao-emb-model
The following is the filling process after obtaining the API Key:
!Enter API Key
Enter [Screen Monitor] to enable the system permissions for screen sharing. After completing the setup, you need to restart the application for the changes to take effect. !Enable-Permissions
After restarting the application, please first set your screen sharing area in [Settings], then click [Start Recording] to begin taking screenshots. !Screen-Settings
After starting the recording, your context will gradually be collected. It will take some time to generate value. So, forget about it and focus on other tasks with peace of mind. MineContext will generate to-dos, prompts, summaries, and activities for you in the background. Of course, you can also engage in proactive Q&A through [Chat with AI].
MineContext supports backend debugging, which can be accessed at http://localhost:1733.
1.View Token Consumption and Usage !后台调试1
2.Configure Interval for Automated Tasks !后台调试2
3.Adjust System Prompt for Automated Tasks !后台调试3
The MineContext frontend is a cross-platform desktop application built with Electron, React, and TypeScript, providing a modular, maintainable, and high-performance foundation for desktop development.
| Technology | Description |
|---|---|
| Electron | Allows for the development of cross-platform desktop applications using web technologies. |
| React | A component-based UI library for building dynamic user interfaces. |
| TypeScript | Provides static type checking to enhance code maintainability. |
| Vite | A modern frontend build tool optimized for Electron. |
| Tailwind CSS | A utility-first CSS framework for rapid and consistent UI styling. |
| pnpm | A fast and efficient package manager suitable for monorepo projects. |
Real-time desktop overlay copilot that watches your screen and listens to calls, delivering contextual answers with profile presets for interviews, sales, and presentations.
AI video note assistant that transcribes Bilibili/YouTube/Douyin videos and generates structured Markdown notes with screenshots, jump links, and customizable styles.
Markdown-native project board for Git repos with CLI, web UI, MCP/AI integration, and offline-friendly Kanban/search built entirely on plain Markdown files.
Peer-to-peer, end-to-end encrypted file and folder transfer over QUIC with resumable downloads, no accounts, and cross-platform desktop builds.
Context-aware Windows overlay assistant that reads your screen and delivers translations, summaries, and answers via multi-LLM backends with a sleek keyboard-driven UI.
WebRTC P2P tool for files, text, and desktop sharing with end-to-end encryption, ACK reliability, Docker/single-binary deploys, and a responsive Next.js UI.