[ { "path": ".devcontainer/devcontainer.json", "content": "// For format details, see https://aka.ms/devcontainer.json. For config options, see the README at:\n// https://github.com/microsoft/vscode-dev-containers/tree/v0.192.0/containers/codespaces-linux\n{\n \"image\": \"mcr.microsoft.com/devcontainers/universal:2\",\n \"containerEnv\": {\n \"GOOGLE_APPLICATION_CREDENTIALS\": \"/home/codespace/.google-cloud-service-account.json\"\n },\n \"postCreateCommand\": \"pnpm install && ./.devcontainer/postbuild\"\n}\n" }, { "path": ".devcontainer/postbuild", "content": "#!/bin/bash -e\nnode core/dev set-up-codespaces" }, { "path": ".gitattributes", "content": "# Don't allow people to merge changes to these generated files, because the result\r\n# may be invalid. You need to run \"rush update\" again.\r\npnpm-lock.yaml merge=binary\r\nshrinkwrap.yaml merge=binary\r\nnpm-shrinkwrap.json merge=binary\r\nyarn.lock merge=binary\r\n\r\n# Rush's JSON config files use JavaScript-style code comments. The rule below prevents pedantic\r\n# syntax highlighters such as GitHub's from highlighting these comments as errors. Your text editor\r\n# may also require a special configuration to allow comments in JSON.\r\n#\r\n# For more information, see this issue: https://github.com/microsoft/rushstack/issues/1088\r\n#\r\n*.json linguist-language=JSON-with-Comments\r\n" }, { "path": ".gitignore", "content": ".env\n.cache\nnode_modules\n/automatron.js\n/automatron.js.map\n/dist/\n*.gz\nwebpack.stats.json\n*.env\n\n# Rush temporary files\ncommon/deploy/\ncommon/temp/\ncommon/autoinstallers/*/.npmrc\n**/.rush/temp/\n\n# Heft\n.heft\n" }, { "path": ".prettierrc", "content": "{\n \"singleQuote\": true,\n \"semi\": false\n}\n" }, { "path": ".vscode/settings.json", "content": "{\n \"cSpell.words\": [\"Automatron\"],\n \"typescript.experimental.useTsgo\": true\n}\n" }, { "path": ".vscode/tasks.json", "content": "{\n \"version\": \"2.0.0\",\n \"tasks\": [\n {\n \"label\": \"pnpm: dev\",\n \"type\": \"shell\",\n \"command\": \"pnpm dev\",\n \"group\": \"build\"\n },\n {\n \"label\": \"pnpm: tunnel\",\n \"type\": \"shell\",\n \"command\": \"pnpm tunnel\",\n \"group\": \"build\"\n },\n {\n \"label\": \"pnpm: dev+tunnel\",\n \"type\": \"shell\",\n \"command\": \"echo Running pnpm dev and pnpm tunnel in parallel...\",\n \"dependsOn\": [\"pnpm: dev\", \"pnpm: tunnel\"],\n \"group\": {\n \"kind\": \"build\",\n \"isDefault\": true\n },\n \"problemMatcher\": []\n }\n ]\n}\n" }, { "path": "README.md", "content": "# automatron\n\nThis is my personal LINE bot that helps me automate various tasks of everyday life, such as\n**home control** (air conditioner, lights and plugs) and **expense tracking** (record how much I spend each day).\n[See below for a feature tour.](#features)\n\nI recommend every developer to try creating their own personal assistant chat bot.\nIt’s a great way to practice coding and improve problem solving skills.\nAnd it helps make life more convenient!\n\nIt is written in TypeScript and runs on [DigitalOcean App Platform](https://www.digitalocean.com/products/app-platform) with Node.js 24.\n\n## features\n\n- [home automation](#home-automation)\n- [expense tracking](#expense-tracking)\n- [transaction aggregation](#transaction-aggregation)\n- [image-to-text](#image-to-text)\n- [livescript evaluation](#livescript-evaluation)\n\n### home automation\n\n![home automation](./images/home_automation.png)\n\nI have a [Home Assistant](https://www.home-assistant.io/) setup which can [control lights](https://www.home-assistant.io/integrations/hue/), [air conditioner](https://www.home-assistant.io/integrations/broadlink/#remote), and [smart plugs](https://www.home-assistant.io/integrations/tplink/). automatron can send commands to [Home Assistant’s REST API](https://developers.home-assistant.io/docs/api/rest/) to control these devices.\n\n### expense tracking\n\n![expense tracking](./images/expense_tracking.png)\n\nSimple expense tracking by typing in the amount + category. Example: 50f means ฿50 for food. Data is saved in [Grist](https://www.getgrist.com/).\n\nOn mobile, tapping the bubble’s body (containing the amount) will take me to the created Grist record. This allows me to easily edit or add remarks to the record.\n\n### transaction aggregation\n\n![transaction_aggregation](./images/transaction_aggregation.png)\n\nI built a [notification exfiltrator](https://docs.dt.in.th/dtinth.tools-android/exfiltrate.html) that send notifications my phone receive to automatron, which saves it to a database for later processing.\n\n### image-to-text\n\n![image_to_text](./images/image_to_text.png)\n\nautomatron can also convert image to text using [Google Cloud Vision API](https://cloud.google.com/vision/).\n\n### livescript evaluation\n\n![livescript](./images/livescript.png)\n\n[LiveScript](https://livescript.net/) interpreter is included, which allows me to do some quick calculations.\n\n### cli / api\n\n![api](./images/api.png)\n\n`POST /text` sends a text command to automatron. This is equivalent to sending a text message through LINE. This allows me to create a CLI tool that lets me talk to automatron from my terminal.\n\n`POST /post` sends a message to my LINE account directly. This allows the [home automation](#home-automation) scripts to report back to me whenever the script is invoked.\n\n`POST /run/automatron/reload` reloads the encrypted environment file (requires `X-API-Key` header with `API_KEY`).\n\n## project structure\n\n- [core](./core) — The core automatron service.\n- [webui](./webui) — The web-based UI running on Vercel.\n\n### other projects\n\n- [automatron-prelude](https://github.dev/dtinth/automatron-prelude/blob/main/prelude.js) contains code experimentation.\n\n### development setup\n\n```sh\n# Run the development server\npnpm dev\n\n# Set up a tunnel using frp\npnpm tunnel\n\n# Update a secret\npnpm env:set SECRET_NAME\n```\n" }, { "path": "core/README.md", "content": "# @dtinth/automatron-core\n\nThe core service of automatron. Provides:\n\n- Chat bot interface (LINE, Slack)\n- REST API interface\n- Cron jobs\n\n## secrets\n\nThe secret data required to run the automation are defined in [BotSecrets.ts](./src/BotSecrets.ts).\n\n## development workflow\n\n### developing\n\nWatches for file changes and deploy the compiled code. Since it is my personal bot (I am the only one using it), I want a save-and-deploy workflow; there is no dev/staging environment at all.\n\n```sh\nnode dev\n```\n\n### configuration\n\n```sh\n# download\ngsutil cp gs://$GOOGLE_CLOUD_PROJECT-evalaas/evalaas/automatron.env automatron.env\n\n# upload\ngsutil cp automatron.env gs://$GOOGLE_CLOUD_PROJECT-evalaas/evalaas/automatron.env\n```\n" }, { "path": "core/package.json", "content": "{\n \"name\": \"@dtinth/automatron-core\",\n \"private\": true,\n \"description\": \"My LINE bot!\",\n \"version\": \"1.0.0\",\n \"license\": \"Apache-2.0\",\n \"author\": \"Google Inc.\",\n \"engines\": {\n \"node\": \">=24\"\n },\n \"repository\": \"https://github.com/dtinth/automatron\",\n \"main\": \"app.js\",\n \"scripts\": {\n \"start\": \"tsx src/server.ts\",\n \"dev\": \"env AUTOMATRON_ENV=dev tsx --watch src/server.ts\"\n },\n \"dependencies\": {\n \"age-encryption\": \"0.2.4\",\n \"google-application-credentials-base64\": \"0.0.0\",\n \"@dtinth/encrypted\": \"^0.3.1\",\n \"@google-cloud/firestore\": \"^5.0.2\",\n \"@google-cloud/storage\": \"^7.18.0\",\n \"@google-cloud/trace-agent\": \"^5.1.6\",\n \"@google-cloud/vision\": \"^2.4.2\",\n \"@line/bot-sdk\": \"^9.2.2\",\n \"@slack/types\": \"^1.10.0\",\n \"@types/cors\": \"~2.8.13\",\n \"airtable\": \"0.5.9\",\n \"axios\": \"0.18.0\",\n \"body-parser\": \"1.18.3\",\n \"cors\": \"~2.8.5\",\n \"citty\": \"0.1.6\",\n \"dotenv\": \"^7.0.0\",\n \"express\": \"4.16.4\",\n \"express-async-handler\": \"~1.2.0\",\n \"express-oauth2-jwt-bearer\": \"~1.1.0\",\n \"form-data\": \"~4.0.0\",\n \"google-auth-library\": \"~7.12.0\",\n \"jsonwebtoken\": \"^8.5.1\",\n \"lib\": \"~4.3.3\",\n \"livescript\": \"1.6.0\",\n \"lodash\": \"^4.17.21\",\n \"mongodb\": \"^4.13.0\",\n \"mqtt\": \"2.18.8\",\n \"nanoid\": \"~3.3.4\",\n \"pino\": \"^7.11.0\",\n \"prelude-ls\": \"1.1.2\",\n \"transaction-parser-th\": \"0.1.1\",\n \"tweetnacl\": \"^1.0.3\",\n \"tweetnacl-sealedbox-js\": \"^1.2.0\",\n \"verror\": \"^1.10.1\",\n \"tsx\": \"^4.21.0\",\n \"grist-api\": \"0.1.7\",\n \"@inquirer/prompts\": \"^8.0.2\"\n },\n \"devDependencies\": {\n \"@types/express\": \"^4.17.15\",\n \"@types/jsonwebtoken\": \"^8.5.9\",\n \"@types/node\": \"^24.10.1\",\n \"@vercel/ncc\": \"^0.36.0\",\n \"execa\": \"^1.0.0\",\n \"ora\": \"^3.4.0\",\n \"typescript\": \"^5.9.3\",\n \"yargs\": \"^13.3.2\"\n }\n}\n" }, { "path": "core/src/BotSecrets.ts", "content": "export interface BotSecrets {\n /** The secret key that must be sent with the request to use the [API](../README.md#cli-api) */\n API_KEY: string\n /** Self-explanatory */\n LINE_CHANNEL_SECRET: string\n /** For development */\n DEV_LINE_CHANNEL_SECRET: string\n /** Self-explanatory */\n LINE_CHANNEL_ACCESS_TOKEN: string\n /** For development */\n DEV_LINE_CHANNEL_ACCESS_TOKEN: string\n /** My user ID, so that the bot receives commands from me only */\n LINE_USER_ID: string\n /** Self-explanatory @deprecated */\n AIRTABLE_API_KEY: string\n /** The ID of the Airtable base used for tracking expenses (should start with ‘app’) @deprecated */\n AIRTABLE_EXPENSE_BASE: string\n /** The web URL to the Airtable base, used for deep linking @deprecated */\n AIRTABLE_EXPENSE_URI: string\n /** The ID of the Airtable base used for cron jobs (should start with ‘app’) @deprecated */\n AIRTABLE_CRON_BASE: string\n /** Two numbers in form of A/B, where A is usage budget per day (rolls over to the next day) and B is starting budget */\n EXPENSE_PACEMAKER: string\n /** Slack webhook URL */\n SLACK_WEBHOOK_URL: string\n /** My user ID, so that the bot receives commands from me only */\n SLACK_USER_ID: string\n /** Google Cloud IoT Core device path to send */\n CLOUD_IOT_CORE_DEVICE_PATH: string\n /** GitHub OAuth App credentials for making unauthenticated API calls with elevated rate limits. In form of \":\" */\n GITHUB_OAUTH_APP_CREDENTIALS: string\n /** Encryption secret for decrypting */\n ENCRYPTION_SECRET: string\n /** Database storage */\n MONGODB_URL: string\n /** Subject ID for Google Auth */\n GOOGLE_AUTH_SUB: string\n\n /** Base URL for Grist */\n GRIST_BASE_URL: string\n /** API key for Grist */\n GRIST_API_KEY: string\n /** Document ID for Grist expense tracking */\n GRIST_EXPENSE_DOC_ID: string\n /** Document URI for Grist expense tracking */\n GRIST_EXPENSE_URI: string\n}\n" }, { "path": "core/src/CodeEvaluation.ts", "content": "import { getCodeExecutionContext } from './PreludeCode'\nimport { AutomatronContext, TextMessageHandler } from './types'\n\nexport async function evaluateCode(input: string, context: AutomatronContext) {\n const code = input.startsWith(';')\n ? input\n : require('livescript')\n .compile(input, {\n run: true,\n print: true,\n header: false,\n })\n .replace(/^\\(function/, '(async function')\n console.log('Code compilation result', code)\n const runner = new Function(\n ...['prelude', 'self', 'code', 'context'],\n 'with (prelude) { with (self) { return [ eval(code) ] } }'\n )\n const self = await getCodeExecutionContext(context)\n const [value] = runner(require('prelude-ls'), self, code, context)\n const returnedValue = await Promise.resolve(value)\n let result = postProcessResult(returnedValue)\n const extraMessages = [...self.extraMessages]\n return { result, extraMessages }\n}\n\nfunction postProcessResult(returnedValue: any) {\n if (typeof returnedValue === 'string') {\n return returnedValue\n }\n return require('util').inspect(returnedValue)\n}\n\nexport const CodeEvaluationMessageHandler: TextMessageHandler = (\n text,\n context\n) => {\n if (text.startsWith(';')) {\n return async () => {\n const input = text.slice(1)\n try {\n var { result, extraMessages } = await evaluateCode(input, context)\n return [{ type: 'text', text: result }, ...extraMessages]\n } catch (error: any) {\n const stack = String(error.stack).replace(\n /\\/evalaas\\/webpack:\\/@dtinth\\/automatron-core\\//g,\n ''\n )\n return [{ type: 'text', text: `❌ EVALUATION FAILED ❌\\n${stack}` }]\n }\n }\n }\n}\n" }, { "path": "core/src/Cron.ts", "content": "import { ObjectId } from 'mongodb'\nimport { getDb } from './MongoDatabase'\nimport { AutomatronContext } from './types'\n\ninterface CronEntry {\n name: string\n scheduledTime: string\n completed: boolean\n notes?: string\n}\n\nexport async function addCronEntry(\n context: AutomatronContext,\n time: number,\n text: string\n) {\n const targetTime = new Date(time)\n targetTime.setUTCSeconds(0)\n targetTime.setUTCMilliseconds(0)\n\n const collection = await getCronCollection(context)\n await collection.insertOne({\n name: text,\n scheduledTime: targetTime.toISOString(),\n completed: false,\n })\n\n return {\n localTime: new Date(targetTime.getTime() + 7 * 3600e3)\n .toJSON()\n .replace(/\\.000Z/, ''),\n }\n}\n\nexport async function getCronCollection(context: AutomatronContext) {\n const db = await getDb(context)\n return db.collection('cronJobs')\n}\n\nexport async function getPendingCronJobs(context: AutomatronContext) {\n const collection = await getCronCollection(context)\n return collection.find({ completed: false }).toArray()\n}\n\nexport async function updateCronJob(\n context: AutomatronContext,\n jobId: string,\n update: Partial\n) {\n const collection = await getCronCollection(context)\n await collection.updateOne({ _id: new ObjectId(jobId) }, { $set: update })\n}\n" }, { "path": "core/src/DataEncryption.ts", "content": "import Encrypted from '@dtinth/encrypted'\nimport { AutomatronContext } from './types'\n\nexport function decrypt(\n context: AutomatronContext,\n encryptedPayload: string\n): any {\n const encrypted = Encrypted(context.secrets.ENCRYPTION_SECRET)\n return encrypted(encryptedPayload)\n}\n\nexport function encrypt(context: AutomatronContext, payload: any): string {\n const encrypted = Encrypted(context.secrets.ENCRYPTION_SECRET)\n return encrypted.encrypt(payload)\n}\n" }, { "path": "core/src/DeviceTracking.ts", "content": "import { getDb } from './MongoDatabase'\nimport { ref } from './PersistentState'\nimport { AutomatronContext } from './types'\nimport { logger } from './logger'\n\nasync function getCollection(context: AutomatronContext) {\n const db = await getDb(context)\n return db.collection('deviceLog')\n}\n\ninterface DeviceLogEntry {\n time: string\n deviceId: string\n key: string\n value: any\n}\n\nasync function getDeviceStateUpdater(\n context: AutomatronContext,\n deviceId: string\n) {\n const collection = await getCollection(context)\n const device = getDeviceRef(context, deviceId)\n const state = (await device.get()) || {}\n const time = new Date().toISOString()\n let changed = false\n return {\n time,\n state,\n update: async (key: string, value: any) => {\n if (JSON.stringify(state[key]) !== JSON.stringify(value)) {\n state[key] = value\n await collection.insertOne({\n time,\n deviceId,\n key,\n value,\n })\n logger.info(\n { deviceId, key, value },\n `Device \"${deviceId}\" property \"${key}\" changed to \"${value}\"`\n )\n changed = true\n }\n },\n updateSilently: async (key: string, value: any) => {\n if (JSON.stringify(state[key]) !== JSON.stringify(value)) {\n state[key] = value\n changed = true\n }\n },\n save: async () => {\n if (changed) {\n await device.set(state)\n }\n },\n }\n}\n\nexport async function trackDevice(\n context: AutomatronContext,\n deviceId: string,\n properties: Record\n) {\n const updater = await getDeviceStateUpdater(context, deviceId)\n if (!('ip' in properties)) {\n properties.ip = context.requestInfo.ip\n }\n for (const [key, value] of Object.entries(properties)) {\n await updater.update(key, value)\n }\n await updater.updateSilently('lastSeen', updater.time)\n await updater.save()\n return updater.state\n}\n\nfunction getDeviceRef(context: AutomatronContext, deviceId: string) {\n return ref(context, 'devices.' + deviceId)\n}\n\nexport async function checkDeviceOnlineStatus(context: AutomatronContext) {\n const deviceIds = await getDeviceIds(context)\n for (const deviceId of deviceIds) {\n const updater = await getDeviceStateUpdater(context, deviceId)\n if (\n updater.state.online &&\n Date.now() - new Date(updater.state.lastSeen).getTime() > 1000 * 60 * 3\n ) {\n await updater.update('online', false)\n }\n await updater.save()\n }\n}\n\nasync function getDeviceIds(context: AutomatronContext) {\n const value = await ref(context, 'deviceIds').get()\n return (value || '').split(',').filter(Boolean)\n}\n" }, { "path": "core/src/ExpenseTracking.ts", "content": "import { messagingApi } from '@line/bot-sdk'\nimport { GristDocAPI } from 'grist-api'\nimport { ExpenseTrackingGristTables } from './ExpenseTrackingGrist'\nimport { createBubble } from './LINEMessageUtilities'\nimport { TypedGristDocAPI } from './TypedGristDocAPI'\nimport { AutomatronContext } from './types'\n\ntype ExpenseRecord = ExpenseTrackingGristTables['Daily_Expenses']\n\nfunction getGristDoc(context: AutomatronContext) {\n const grist = new GristDocAPI(context.secrets.GRIST_EXPENSE_DOC_ID, {\n server: context.secrets.GRIST_BASE_URL,\n apiKey: context.secrets.GRIST_API_KEY,\n })\n return grist as TypedGristDocAPI\n}\n\nexport async function recordExpense(\n context: AutomatronContext,\n amount: string,\n category: string,\n remarks = ''\n): Promise {\n const date = new Date().toJSON().split('T')[0]\n // Airtable\n const doc = getGristDoc(context)\n const [id] = await doc.addRecords('Daily_Expenses', [\n {\n Date: new Date(date + 'T00:00:00Z').getTime() / 1000,\n Category: category,\n Amount: parseInt(amount),\n Note: remarks,\n },\n ])\n const gristUri =\n context.secrets.GRIST_EXPENSE_URI +\n `?openExternalBrowser=1#a1.s12.r${id}.c28`\n const body: messagingApi.FlexBox = {\n type: 'box',\n layout: 'vertical',\n contents: [\n {\n type: 'text',\n text: '฿' + amount,\n size: 'xxl',\n weight: 'bold',\n },\n {\n type: 'text',\n text: `${category}\\nrecorded`,\n wrap: true,\n },\n ],\n action: {\n type: 'uri',\n label: 'Open Grist',\n uri: gristUri,\n },\n }\n const footer = await getExpensesSummaryData(context)\n const bubble = createBubble('expense tracking', body, {\n headerColor: '#ffffbb',\n footer: {\n type: 'box',\n layout: 'horizontal',\n spacing: 'sm',\n contents: footer.map(([label, text]) => ({\n type: 'box',\n layout: 'vertical',\n contents: [\n {\n type: 'text',\n text: label,\n color: '#8b8685',\n size: 'xs',\n align: 'end',\n },\n {\n type: 'text',\n text: text,\n color: '#8b8685',\n size: 'sm',\n align: 'end',\n },\n ],\n })),\n action: {\n type: 'uri',\n label: 'Open Grist',\n uri: gristUri,\n },\n },\n })\n return bubble\n}\nasync function getExpensesSummaryData(context: AutomatronContext) {\n const date = new Date().toJSON().split('T')[0]\n const gristToDate = (t: number) =>\n new Date(t * 1000).toISOString().split('T')[0]\n const grist = getGristDoc(context)\n const tableData = await grist.fetchTable('Daily_Expenses')\n const normalRecords = tableData.filter((r) => !r['Occasion'])\n const total = (records: ExpenseRecord[]) =>\n records.map((r) => +r['Amount'] || 0).reduce((a, b) => a + b, 0)\n const firstDate = normalRecords\n .map((r) => gristToDate(r['Date']))\n .reduce((a, b) => (a < b ? a : b), date)\n const todayUsage = total(\n normalRecords.filter((r) => gristToDate(r['Date']) === date)\n )\n const totalUsage = total(normalRecords)\n const dayNumber =\n Math.round((Date.parse(date) - Date.parse(firstDate)) / 86400e3) + 1\n const [pacemakerPerDay, pacemakerBase] =\n context.secrets.EXPENSE_PACEMAKER.split('/')\n const pacemaker = +pacemakerBase + +pacemakerPerDay * dayNumber - totalUsage\n const $ = (v: number) => `฿${v.toFixed(0)}`\n return [\n ['today', $(todayUsage)],\n ['pace', $(pacemaker)],\n ['day', `${dayNumber}`],\n ]\n}\n" }, { "path": "core/src/ExpenseTrackingGrist.ts", "content": "export namespace grist {\n export type Text = string\n export type Numeric = number\n export type Int = number\n export type Bool = boolean\n export type Date = number\n export type DateTime = string\n export type Choice = string\n export type Reference = number\n export type ReferenceList = ['L', ...number[]] | null\n export type ChoiceList = ['L', ...string[]] | null\n export type Attachments = ['L', ...number[]] | null\n export type Any = any\n}\n\nexport type ExpenseTrackingGristTables = {\n Daily_Expenses: {\n id: number\n Date: grist.Date\n Amount: grist.Numeric\n Category: grist.Choice\n Beneficiary: grist.Choice\n Note: grist.Text\n Occasion: grist.Bool\n Month: grist.Any // calculated/formula\n Daily_Amount: grist.Numeric // calculated/formula\n }\n}\n" }, { "path": "core/src/HomeAutomation.ts", "content": "import Encrypted from '@dtinth/encrypted'\nimport { AutomatronContext } from './types'\nimport axios from 'axios'\n\nexport async function sendHomeCommand(\n context: AutomatronContext,\n cmd: string | string[]\n): Promise {\n const cmds = Array.isArray(cmd) ? cmd : [cmd]\n const encrypted = Encrypted(context.secrets.ENCRYPTION_SECRET)\n const { url, key } = encrypted`mz8Dc0LiBPPI63I5lMJHdC3RC9VF//S2.QYg30oYhuEUS8b1u80vM7sO0cv4OLYNtxy52fTMnf2Vcg8QZHlLeXUV1qPnEjR/5jYTid5hG6of8mHDHjTE1A+luDzplgM4WJQBgDNM2pkRnKnbcmAUw8MXxBb4ZMqrrAyFELigKoELWwbDg51ErhFXrm+n3hzfpbRIcge1BdH6aEPtNipsUcMj7q7BfBqFLZA==`\n await Promise.all(\n cmds.map(async (command) => {\n const id =\n new Date().toJSON() +\n Math.floor(Math.random() * 10000)\n .toString()\n .padStart(2, '0')\n await axios.post(url, { id, topic: 'home', data: command }, {\n headers: {\n 'X-Api-Key': key\n }\n })\n })\n )\n}\n" }, { "path": "core/src/ImageMessageHandler.ts", "content": "import vision from '@google-cloud/vision'\nimport { ref } from './PersistentState'\nimport { getBlob, getBlobUrl } from './TemporaryBlobStorage'\nimport { TextMessage, TextMessageHandler } from './types'\n\nexport const ImageMessageHandler: TextMessageHandler = (text, context) => {\n if (text.startsWith('image:')) {\n return async () => {\n const blobName = text.slice(6)\n await ref(context, 'latestImage').set(blobName)\n return [{ type: 'text', text: blobName }]\n }\n }\n if (text === 'annotate') {\n return async () => {\n const blobName = await ref(context, 'latestImage').get()\n return await annotateImage(blobName)\n }\n }\n if (text === 'image url') {\n return async () => {\n const blobName = await ref(context, 'latestImage').get()\n return await getBlobUrl(blobName)\n }\n }\n}\n\nasync function annotateImage(blobName: string) {\n const buffer = await getBlob(blobName)\n const imageAnnotator = new vision.ImageAnnotatorClient()\n const results = await imageAnnotator.documentTextDetection(buffer)\n const fullTextAnnotation = results[0].fullTextAnnotation\n const blocks: string[] = []\n for (const page of fullTextAnnotation.pages) {\n blocks.push(\n ...page.blocks.map((block) => {\n return block.paragraphs\n .map((p) =>\n p.words.map((w) => w.symbols.map((s) => s.text).join('')).join(' ')\n )\n .join('\\n\\n')\n })\n )\n }\n const blocksToResponses = (blocks: string[]) => {\n if (blocks.length <= 4) return blocks\n let processedIndex = 0\n const outBlocks = []\n for (let i = 0; i < 4; i++) {\n const targetIndex = Math.ceil(((i + 1) * blocks.length) / 4)\n outBlocks.push(\n blocks\n .slice(processedIndex, targetIndex)\n .map((x) => `・ ${x}`)\n .join('\\n')\n )\n processedIndex = targetIndex\n }\n return outBlocks\n }\n const responses = blocksToResponses(blocks)\n return [...responses.map((r): TextMessage => ({ type: 'text', text: r }))]\n}\n" }, { "path": "core/src/LINEClient.ts", "content": "import { messagingApi } from '@line/bot-sdk'\n\nexport class LINEClient {\n private readonly api: messagingApi.MessagingApiClient\n private readonly blobApi: messagingApi.MessagingApiBlobClient\n constructor(config: { channelAccessToken: string }) {\n this.api = new messagingApi.MessagingApiClient({\n channelAccessToken: config.channelAccessToken,\n })\n this.blobApi = new messagingApi.MessagingApiBlobClient({\n channelAccessToken: config.channelAccessToken,\n })\n }\n replyMessage(replyToken: string, messages: messagingApi.Message[]) {\n return this.api.replyMessage({ replyToken, messages })\n }\n pushMessage(to: string, messages: messagingApi.Message[]) {\n return this.api.pushMessage({ to, messages })\n }\n getMessageContent(messageId: string) {\n return this.blobApi.getMessageContent(messageId)\n }\n showLoadingAnimation(chatId: string) {\n return this.api.showLoadingAnimation({ chatId })\n }\n}\n" }, { "path": "core/src/LINEMessageUtilities.ts", "content": "import { messagingApi } from '@line/bot-sdk'\n\nexport function toMessages(data: any): messagingApi.Message[] {\n if (!data) data = '...'\n if (typeof data === 'string') data = [{ type: 'text', text: data }]\n if (!Array.isArray(data)) data = [data]\n return data\n}\n\nexport function createBubble(\n title: string,\n text: string | messagingApi.FlexBox,\n {\n headerBackground = '#353433',\n headerColor = '#d7fc70',\n textSize = 'xl',\n altText = String(text),\n footer,\n }: {\n headerBackground?: string\n headerColor?: string\n textSize?: messagingApi.FlexText['size']\n altText?: string\n footer?: string | messagingApi.FlexBox\n } = {}\n): messagingApi.FlexMessage {\n const data: messagingApi.FlexContainer = {\n type: 'bubble',\n styles: {\n header: { backgroundColor: headerBackground },\n },\n header: {\n type: 'box',\n layout: 'vertical',\n contents: [\n { type: 'text', text: title, color: headerColor, weight: 'bold' },\n ],\n },\n body:\n typeof text === 'string'\n ? {\n type: 'box',\n layout: 'vertical',\n contents: [\n { type: 'text', text: text, wrap: true, size: textSize },\n ],\n }\n : text,\n }\n if (footer) {\n data.styles!.footer = { backgroundColor: '#e9e8e7' }\n data.footer =\n typeof footer === 'string'\n ? {\n type: 'box',\n layout: 'vertical',\n contents: [\n {\n type: 'text',\n text: footer,\n wrap: true,\n size: 'sm',\n color: '#8b8685',\n },\n ],\n }\n : footer\n }\n return {\n type: 'flex',\n altText: truncate(`[${title}] ${altText}`, 400),\n contents: data,\n }\n}\n\nfunction truncate(text: string, maxLength: number) {\n return text.length + 5 > maxLength\n ? text.substr(0, maxLength - 5) + '…'\n : text\n}\n" }, { "path": "core/src/LanguageModelAssistant.ts", "content": "import axios from 'axios'\nimport { decrypt } from './DataEncryption'\nimport { logger } from './logger'\nimport { getDb } from './MongoDatabase'\nimport { ref } from './PersistentState'\nimport {\n AutomatronContext,\n AutomatronResponse,\n TextMessageHandler,\n} from './types'\n\ntype Role = 'system' | 'user' | 'assistant'\ninterface ChatMessage {\n role: Role\n content: string\n}\ninterface LlmHistoryEntry {\n time: string\n contextMessages?: ChatMessage[]\n inText: string\n outText: string\n}\n\nasync function getCollection(context: AutomatronContext) {\n const db = await getDb(context)\n return db.collection('llmHistory')\n}\n\nexport const LanguageModelAssistantMessageHandler: TextMessageHandler = (\n text,\n context\n) => {\n const runLlm = async (\n inText: string,\n continueFrom?: LlmHistoryEntry\n ): Promise => {\n const key = decrypt(\n context,\n 'c0wgjM3RJp/V40lLhcHbtjUDBvlT/NlI.yF9iWwImsHrUOiZkD6UMZdGyjLd3yCJm7WMkN6dxerzXlxCK4U6bSzNFHwyvUjPDop4+gLCs5Qa9Pcxwii3DvSVjjE+7'\n )\n const nowIct = new Date(Date.now() + 7 * 3600e3)\n const day = [\n 'Sunday',\n 'Monday',\n 'Tuesday',\n 'Wednesday',\n 'Thursday',\n 'Friday',\n 'Saturday',\n ][nowIct.getDay()]\n\n const prompt: string[] = [\n // https://beta.openai.com/examples/default-chat\n 'Current date and time: ' +\n nowIct.toISOString().replace('Z', '+07:00') +\n ' (Asia/Bangkok).',\n 'Today is ' + day + '.',\n 'The following is a conversation with an AI assistant, automatron. ' +\n 'The assistant is helpful, creative, clever, funny, and very friendly. ' +\n (await ref(context, 'llmPrompt').get()),\n ]\n const newContext: ChatMessage[] = [\n ...(continueFrom\n ? [\n ...(continueFrom.contextMessages ?? []),\n { role: 'user' as Role, content: continueFrom.inText },\n { role: 'assistant' as Role, content: continueFrom.outText },\n ]\n : []),\n ]\n const messages: ChatMessage[] = [\n { role: 'system', content: prompt.join('\\n') },\n ...newContext,\n { role: 'user', content: inText },\n ]\n const payload = {\n model: 'chatgpt-4o-latest',\n messages,\n temperature: +(await ref(context, 'llmTemperature').get()) || 0.5,\n }\n const response = await axios.post(\n 'https://api.openai.com/v1/chat/completions',\n payload,\n { headers: { Authorization: `Bearer ${key}` } }\n )\n const responseText = response.data.choices[0].message.content.trim()\n logger.info(\n { assistant: { prompt, response: response.data } },\n 'Ran OpenAI assistant'\n )\n const collection = await getCollection(context)\n await collection.insertOne({\n time: new Date().toISOString(),\n contextMessages: newContext,\n inText,\n outText: responseText,\n })\n return [{ type: 'text', text: responseText }]\n }\n\n if (text.match(/^hey\\b/i)) {\n return async () => {\n return runLlm(text)\n }\n }\n if (text.match(/^hmm?\\b/i)) {\n return async () => {\n const collection = await getCollection(context)\n const [lastEntry] = await collection\n .find({})\n .sort({ _id: -1 })\n .limit(1)\n .toArray()\n return runLlm(text, lastEntry)\n }\n }\n}\n" }, { "path": "core/src/MessageHandler.ts", "content": "import { CodeEvaluationMessageHandler } from './CodeEvaluation'\nimport { addCronEntry } from './Cron'\nimport { recordExpense } from './ExpenseTracking'\nimport { sendHomeCommand } from './HomeAutomation'\nimport { ImageMessageHandler } from './ImageMessageHandler'\nimport { LanguageModelAssistantMessageHandler } from './LanguageModelAssistant'\nimport {\n MessageHistoryMessageHandler,\n saveMessageHistory,\n} from './MessageHistory'\nimport { getDb } from './MongoDatabase'\nimport { ref } from './PersistentState'\nimport { PhoneFinderMessageHandler } from './PhoneFinder'\nimport { getCodeExecutionContext } from './PreludeCode'\nimport { decodeRomanNumerals } from './RomanNumerals'\nimport { SpendingTrackingMessageHandler } from './SpendingTracking'\nimport { putBlob } from './TemporaryBlobStorage'\nimport { trace } from './Tracing'\nimport { AutomatronContext, AutomatronResponse } from './types'\n\nconst messageHandlers = [\n CodeEvaluationMessageHandler,\n ImageMessageHandler,\n MessageHistoryMessageHandler,\n SpendingTrackingMessageHandler,\n PhoneFinderMessageHandler,\n LanguageModelAssistantMessageHandler,\n]\n\nexport async function handleTextMessage(\n context: AutomatronContext,\n message: string,\n options: { source: string }\n): Promise {\n message = message.trim()\n let match: RegExpMatchArray | null\n\n context.addPromise(\n 'Save text history',\n getDb(context).then((db) =>\n trace(context, 'Save history', () =>\n saveMessageHistory(context, message, options.source)\n )\n )\n )\n\n if (message === 'ac on' || message === 'sticker:2:27') {\n await sendHomeCommand(context, 'ac on')\n return 'ok, turning air-con on'\n } else if (message === 'ac off' || message === 'sticker:2:29') {\n await sendHomeCommand(context, 'ac off')\n return 'ok, turning air-con off'\n } else if (message === 'power on' || message === 'plugs on') {\n await sendHomeCommand(context, 'plugs on')\n return 'ok, turning smart plugs on'\n } else if (message === 'power off' || message === 'plugs off') {\n await sendHomeCommand(context, 'plugs off')\n return 'ok, turning smart plugs off'\n } else if (\n message === 'home' ||\n message === 'arriving' ||\n message === 'sticker:2:503'\n ) {\n await sendHomeCommand(context, ['plugs on', 'lights normal', 'ac on'])\n return 'preparing home'\n } else if (message === 'leaving' || message === 'sticker:2:502') {\n await sendHomeCommand(context, ['plugs off', 'lights off', 'ac off'])\n return 'bye'\n } else if (message === 'lights' || message === 'sticker:4:275') {\n await sendHomeCommand(context, 'lights normal')\n return 'ok, lights normal'\n } else if (\n message === 'bedtime' ||\n message === 'gn' ||\n message === 'gngn' ||\n message === 'sticker:11539:52114128'\n ) {\n await sendHomeCommand(context, 'lights dimmed')\n await addCronEntry(context, Date.now() + 300e3, 'lights off')\n const prelude = await getCodeExecutionContext(context)\n await prelude.executeHandlers('bedtime')\n return 'ok, good night'\n } else if (message === 'ooo') {\n const prelude = await getCodeExecutionContext(context)\n await prelude.executeHandlers('ooo')\n return 'ok, out of office'\n } else if (message === 'work') {\n const prelude = await getCodeExecutionContext(context)\n await prelude.executeHandlers('work')\n return 'ok, set working status'\n } else if ((match = message.match(/^lights (\\w+)$/))) {\n const cmd = match[1]\n await sendHomeCommand(context, 'lights ' + cmd)\n return 'ok, lights ' + cmd\n } else if ((match = message.match(/^in ([\\d\\.]+)([mh]),?\\s+([^]+)$/))) {\n const targetTime =\n Date.now() + +match[1] * (match[2] === 'm' ? 60 : 3600) * 1e3\n const result = await addCronEntry(context, targetTime, match[3])\n return `will run \"${match[3]}\" at ${result.localTime}`\n } else if ((match = message.match(/^([\\d.]+|[ivxlcdm]+)(j?)([tfghmol])$/i))) {\n const m = match\n const enteredAmount = m[1].match(/[ivxlcdm]/)\n ? decodeRomanNumerals(m[1])\n : +m[1]\n const conversionRate = m[2] ? 0.302909 : 1\n const amount = (enteredAmount * conversionRate).toFixed(2)\n const category = (\n {\n f: 'Food',\n t: 'Transportation',\n s: 'Stationery',\n g: 'Grocery',\n h: 'Hygiene',\n m: 'Medicine',\n w: 'Wellness',\n // o: 'occasion',\n // l: 'lodging',\n } as {\n [k: string]: string\n }\n )[m[3].toLowerCase()]\n const remarks = m[2] ? `${m[1]} JPY` : ''\n return await recordExpense(context, amount, category, remarks)\n } else if ((match = message.match(/^([ivxlcdm]+)$/i))) {\n return `${match[1]} = ${decodeRomanNumerals(match[1])}`\n }\n\n // Go through message handlers and see if any of them can handle the message\n for (const handler of messageHandlers) {\n const action = handler(message, context)\n if (action) {\n return action()\n }\n }\n\n // At this point, the message is not recognized.\n // Just save it to the stack.\n const size = await ref(context, 'stack').push(message)\n return '(unrecognized message, saved to stack (size=' + size + '))'\n}\n\nexport async function handleImage(\n context: AutomatronContext,\n imageBuffer: Buffer,\n options: { source: string }\n) {\n const blobName = await putBlob(imageBuffer, '.jpg')\n return await handleTextMessage(context, 'image:' + blobName, options)\n}\n" }, { "path": "core/src/MessageHistory.ts", "content": "import { getDb } from './MongoDatabase'\nimport { AutomatronContext, TextMessage, TextMessageHandler } from './types'\n\nexport interface MessageHistoryEntry {\n time: string\n text: string\n source: string\n}\n\nexport async function saveMessageHistory(\n context: AutomatronContext,\n text: string,\n source: string\n) {\n const db = await getDb(context)\n await db.collection('history').insertOne({\n time: new Date().toISOString(),\n text: text,\n source: source,\n })\n}\n\nexport async function getMessageHistory(\n context: AutomatronContext,\n options: { limit: number }\n) {\n const db = await getDb(context)\n return await db\n .collection('history')\n .find({})\n .sort({ _id: -1 })\n .limit(options.limit)\n .toArray()\n}\n\nexport const MessageHistoryMessageHandler: TextMessageHandler = (\n text,\n context\n) => {\n if (text === 'history') {\n return async () => {\n const history = await getMessageHistory(context, { limit: 5 })\n return [...history]\n .reverse()\n .map((entry): TextMessage => ({ type: 'text', text: entry.text }))\n }\n }\n}\n" }, { "path": "core/src/MongoDatabase.ts", "content": "import { Db, MongoClient } from 'mongodb'\nimport { trace } from './Tracing'\nimport { AutomatronContext } from './types'\n\nexport { Db } from 'mongodb'\n\nconst globalCacheKey = Symbol.for('automatron/MongoDatabase')\nconst cache: { dbPromise: Promise | null } = (() => {\n return ((global as any)[globalCacheKey] = (global as any)[globalCacheKey] || {\n dbPromise: null,\n })\n})()\n\nexport async function getDb(context: AutomatronContext): Promise {\n if (cache.dbPromise) {\n return cache.dbPromise\n }\n cache.dbPromise = trace(context, 'getDb', async () => {\n const client = await MongoClient.connect(context.secrets.MONGODB_URL)\n const db = client.db('automatron')\n return db\n })\n cache.dbPromise.catch(() => {\n cache.dbPromise = null\n })\n return cache.dbPromise\n}\n" }, { "path": "core/src/NotificationProcessor.ts", "content": "import { getDb } from './MongoDatabase'\nimport { AutomatronContext } from './types'\nimport { logger } from './logger'\n\nexport interface INotification {\n packageName: string\n text: string\n title: string\n time: string\n postTime: string\n when: string\n key: string\n}\n\nexport async function handleNotification(\n context: AutomatronContext,\n notification: INotification\n) {\n const text = notification.title + ' : ' + notification.text\n const time = notification.when || notification.postTime || notification.time\n const key = notification.key\n const promises: Promise[] = []\n const process = (name: string, promise: Promise) => {\n promises.push(\n promise.catch((err) => {\n logger.error({ err, name }, `Unable to run processor \"${name}\": ${err}`)\n })\n )\n }\n\n process('save to DB', saveNotificationToDb(context, notification))\n\n if (notification.packageName === 'com.kasikorn.retail.mbanking.wap') {\n process('process KBank', handleKbankNotification(context, key, text, time))\n }\n\n return Promise.all(promises)\n}\n\nasync function saveNotificationToDb(\n context: AutomatronContext,\n notification: INotification\n) {\n const db = await getDb(context)\n await db\n .collection('notis')\n .insertOne({ received: new Date().toISOString(), ...notification })\n}\n\nexport async function handleKbankNotification(\n context: AutomatronContext,\n key: string,\n text: string,\n time: string = new Date().toISOString()\n) {\n let m: RegExpMatchArray | null\n\n m = text.match(\n /^รายการใช้บัตร : หมายเลขบัตร (\\S+) จำนวนเงิน (\\S+) (\\S+) ที่ ([^]*)$/\n )\n if (m) {\n const db = await getDb(context)\n db.collection('txs').insertOne({\n notificationKey: key,\n time,\n type: 'charge',\n card: m[1],\n amount: parseAmount(m[2]),\n currency: m[3],\n merchant: m[4],\n })\n return\n }\n\n m = text.match(\n /^รายการยกเลิก : หมายเลขบัตร (\\S+) จำนวนเงิน (\\S+) (\\S+) ที่ ([^]*)$/\n )\n if (m) {\n const db = await getDb(context)\n db.collection('txs').insertOne({\n notificationKey: key,\n time,\n type: 'refund',\n card: m[1],\n amount: parseAmount(m[2]),\n currency: m[3],\n merchant: m[4],\n })\n return\n }\n}\n\nfunction parseAmount(text: string) {\n return +text.replace(/,/g, '')\n}\n" }, { "path": "core/src/PersistentState.ts", "content": "import { getDb } from './MongoDatabase'\nimport { trace } from './Tracing'\nimport { AutomatronContext } from './types'\n\ninterface StateDoc {\n _id: string\n value: any\n}\n\ninterface StateDocStack extends StateDoc {\n value: any[]\n}\n\nasync function push(\n context: AutomatronContext,\n key: string,\n value: any\n): Promise {\n const db = await getDb(context)\n const result = await trace(context, `read(${key})`, () =>\n db\n .collection('state')\n .findOneAndUpdate(\n { _id: key },\n { $push: { value } },\n { upsert: true, returnDocument: 'after' }\n )\n )\n return result.value!.value.length\n}\n\nasync function pop(context: AutomatronContext, key: string): Promise {\n const db = await getDb(context)\n const result = await trace(context, `pop(${key})`, () =>\n db\n .collection('state')\n .findOneAndUpdate({ _id: key }, { $pop: { value: 1 } })\n )\n return result.value!.value.pop()\n}\n\nasync function get(context: AutomatronContext, key: string): Promise {\n const db = await getDb(context)\n const result = await trace(context, `get(${key})`, () =>\n db.collection('state').findOne({ _id: key })\n )\n return result?.value\n}\n\nasync function set(\n context: AutomatronContext,\n key: string,\n value: any\n): Promise {\n const db = await getDb(context)\n const result = await trace(context, `set(${key})`, () =>\n db\n .collection('state')\n .findOneAndUpdate(\n { _id: key },\n { $set: { value } },\n { upsert: true, returnDocument: 'after' }\n )\n )\n return !!result.ok\n}\n\nexport function ref(context: AutomatronContext, key: string) {\n return {\n push: push.bind(null, context, key),\n pop: pop.bind(null, context, key),\n get: get.bind(null, context, key),\n set: set.bind(null, context, key),\n }\n}\n" }, { "path": "core/src/PhoneFinder.ts", "content": "import { TextMessageHandler } from './types'\nimport { GoogleAuth } from 'google-auth-library'\nimport axios from 'axios'\nimport { decrypt } from './DataEncryption'\n\nconst auth = new GoogleAuth()\n\nexport const PhoneFinderMessageHandler: TextMessageHandler = (\n text,\n context\n) => {\n if (text === 'where is my phone') {\n return async () => {\n const url = decrypt(\n context,\n '09oTErU3ru/YqzCNmUBIH2ftVYz1jSfG.NODxXCib7BiuF0vAtnxpwbsvVQ5fxNVXoYDYGZHmJNxBRLPfAWj9KmAK89cOjCtFw3uxudSjqCV1F79Icmn3/SWwi5Z313xXkKyJFr9YWT/1dq8+EWcZfbPR'\n )\n const client = await auth.getIdTokenClient(url)\n const jwt = await client.idTokenProvider.fetchIdToken(url)\n await axios.post(url, {}, { headers: { Authorization: `Bearer ${jwt}` } })\n return 'calling you now...'\n }\n }\n}\n" }, { "path": "core/src/PreludeCode.ts", "content": "import axios from 'axios'\nimport { Storage } from '@google-cloud/storage'\nimport { AutomatronContext } from './types'\nimport tweetnacl from 'tweetnacl'\nimport jsonwebtoken from 'jsonwebtoken'\nimport crypto from 'crypto'\nimport util from 'util'\nimport Encrypted from '@dtinth/encrypted'\nimport { logger } from './logger'\nimport * as mongodb from 'mongodb'\nimport * as os from 'os'\nimport { Db, getDb } from './MongoDatabase'\nimport * as NotificationProcessor from './NotificationProcessor'\nimport * as PersistentState from './PersistentState'\nimport { getAllSpeedDials, getSpeedDialCode, saveSpeedDial } from './SpeedDial'\n\nconst lib = require('lib')\nconst storage = new Storage()\nconst preludeFile = storage.bucket('dtinth-automatron-data').file('prelude.js')\n\nexport async function deployPrelude(context: AutomatronContext) {\n const userPreludeResponse = await axios.get(\n 'https://api.github.com/repos/dtinth/automatron-prelude/contents/prelude.js',\n {\n auth: {\n username: context.secrets.GITHUB_OAUTH_APP_CREDENTIALS.split(':')[0],\n password: context.secrets.GITHUB_OAUTH_APP_CREDENTIALS.split(':')[1],\n },\n }\n )\n const buffer = Buffer.from(userPreludeResponse.data.content, 'base64')\n await preludeFile.save(buffer)\n await PersistentState.ref(context, 'preludeDeployedAt').set(\n new Date().toISOString()\n )\n}\n\nlet cache: { deployedAt: string; code: string } | undefined\n\nexport async function getPreludeCode(context: AutomatronContext) {\n const latestDeployedAt = await PersistentState.ref(\n context,\n 'preludeDeployedAt'\n ).get()\n if (cache && cache.deployedAt === latestDeployedAt) {\n return cache.code\n }\n const [buffer] = await preludeFile.download()\n const code = buffer.toString('utf8')\n cache = {\n deployedAt: latestDeployedAt,\n code,\n }\n return code\n}\n\nexport async function getCodeExecutionContext(\n context: AutomatronContext\n): Promise {\n // Prepare \"self\" context\n const self: any = {}\n self.exec = (code: string) => {\n return new Function(\n ...['self', 'code'],\n 'with (self) { return eval(code) }'\n )(self, code)\n }\n self.encrypted = Encrypted(context.secrets.ENCRYPTION_SECRET)\n self.extraMessages = []\n self.withDb = (f: (db: Db) => any) => getDb(context).then(f)\n self.ref = PersistentState.ref.bind(null, context)\n self.stack = self.ref('stack')\n self.require = (id: string) => {\n const availableModules: { [id: string]: any } = {\n axios,\n tweetnacl,\n jsonwebtoken,\n crypto,\n util,\n mongodb,\n os,\n lib,\n '@/NotificationProcessor': NotificationProcessor,\n }\n const available = {}.hasOwnProperty.call(availableModules, id)\n if (!available) {\n throw new Error(\n `Module ${id} not available; available modules: ${Object.keys(\n availableModules\n )}`\n )\n }\n return availableModules[id]\n }\n self.json = (x: any) => JSON.stringify(x, null, 2)\n self.SD = async (name?: string, f?: () => any) => {\n if (name && f) {\n if (typeof f !== 'function') {\n throw new Error('f must be a function')\n }\n await saveSpeedDial(context, name, f.toString())\n return 'Saved speed dial'\n } else if (name) {\n const code = await getSpeedDialCode(context, name)\n self.extraMessages.push({\n type: 'text',\n text: `;;SD('${name}', ${code})`,\n })\n return self.exec(code)()\n } else {\n const all = await getAllSpeedDials(context)\n return all.map((s) => s._id)\n }\n }\n\n // Plugin system\n type Handler = (...args: any[]) => Promise\n const registeredHandlers: Record> = {}\n self.registerHandler = (event: string, handler: Handler) => {\n if (!registeredHandlers[event]) {\n registeredHandlers[event] = new Set()\n }\n registeredHandlers[event].add(handler)\n }\n self.executeHandlers = async (event: string, ...args: any[]) => {\n await Promise.all(\n [...(registeredHandlers[event] || [])].map(async (handler, i) => {\n try {\n const start = Date.now()\n await handler(...args)\n const elapsed = Date.now() - start\n logger.info(\n `Done executing handler index ${i} for event ${event} in ${elapsed} ms`\n )\n } catch (error) {\n logger.error(\n { err: error },\n `Unable to execute handler index ${i} for event ${event}: ${error}`\n )\n }\n })\n )\n }\n\n // Execute user prelude\n const userPrelude = await getPreludeCode(context)\n self.exec(userPrelude)\n\n return self\n}\n" }, { "path": "core/src/RomanNumerals.ts", "content": "export function decodeRomanNumerals(romanNumerals: string) {\n const decode = (s: string): number => {\n if (s.startsWith('M')) return 1000 + decode(s.substr(1))\n if (s.startsWith('CM')) return 900 + decode(s.substr(2))\n if (s.startsWith('D')) return 500 + decode(s.substr(1))\n if (s.startsWith('CD')) return 400 + decode(s.substr(2))\n if (s.startsWith('C')) return 100 + decode(s.substr(1))\n if (s.startsWith('XC')) return 90 + decode(s.substr(2))\n if (s.startsWith('L')) return 50 + decode(s.substr(1))\n if (s.startsWith('XL')) return 40 + decode(s.substr(2))\n if (s.startsWith('X')) return 10 + decode(s.substr(1))\n if (s.startsWith('IX')) return 9 + decode(s.substr(2))\n if (s.startsWith('V')) return 5 + decode(s.substr(1))\n if (s.startsWith('IV')) return 4 + decode(s.substr(2))\n if (s.startsWith('I')) return 1 + decode(s.substr(1))\n if (s === '') return 0\n throw new InvalidRomanNumeralError(s)\n }\n try {\n return decode(romanNumerals.toUpperCase())\n } catch (e) {\n if (e instanceof InvalidRomanNumeralError) {\n throw new InvalidRomanNumeralError(romanNumerals)\n }\n throw e\n }\n}\n\nclass InvalidRomanNumeralError extends Error {\n constructor(s: string) {\n super('Invalid roman numeral in input ' + s)\n }\n}\n" }, { "path": "core/src/SMSHandler.ts", "content": "import { messagingApi, QuickReplyItem } from '@line/bot-sdk'\nimport { AutomatronContext } from './types'\nimport { recordExpense } from './ExpenseTracking'\nimport { createBubble } from './LINEMessageUtilities'\nimport { LINEClient } from './LINEClient'\n\nexport async function handleSMS(\n context: AutomatronContext,\n client: LINEClient,\n text: string\n) {\n const { parseSMS } = require('transaction-parser-th')\n const result = parseSMS(text)\n if (!result || !result.amount) return { match: false }\n console.log('SMS parsing result', result)\n const title = result.type\n const pay = result.type === 'pay'\n const moneyOut = ['pay', 'transfer', 'withdraw'].includes(result.type)\n const body: messagingApi.FlexBox = {\n type: 'box',\n layout: 'vertical',\n contents: [\n {\n type: 'text',\n text: '฿' + result.amount,\n size: 'xxl',\n weight: 'bold',\n },\n ],\n }\n const ordering = ['provider', 'from', 'to', 'via', 'date', 'time', 'balance']\n const skip = ['type', 'amount']\n const getOrder = (key: string) => ordering.indexOf(key) + 1 || 999\n for (const key of Object.keys(result)\n .filter((key) => !skip.includes(key))\n .sort((a, b) => getOrder(a) - getOrder(b))) {\n body.contents.push({\n type: 'box',\n layout: 'horizontal',\n spacing: 'md',\n contents: [\n {\n type: 'text',\n text: key,\n align: 'end',\n color: '#888888',\n flex: 2,\n },\n {\n type: 'text',\n text: String(result[key]),\n flex: 5,\n },\n ],\n })\n }\n const quickReply = (suffix: string, label: string): QuickReplyItem => ({\n type: 'action',\n action: {\n type: 'message',\n label: label,\n text: result.amount + suffix,\n },\n })\n const messages: messagingApi.Message[] = [\n {\n ...createBubble(title, body, {\n headerBackground: pay ? '#91918F' : moneyOut ? '#DA9E00' : '#9471FF',\n headerColor: '#FFFFFF',\n altText: require('util').inspect(result),\n }),\n quickReply: {\n items: [\n quickReply('f', 'food'),\n quickReply('h', 'health'),\n quickReply('t', 'transport'),\n quickReply('m', 'misc'),\n quickReply('o', 'occasion'),\n ],\n },\n },\n ]\n if (result.type === 'pay' && result.to === 'LINEPAY*BTS01') {\n messages.push(\n await recordExpense(context, result.amount, 'transportation', 'BTS')\n )\n }\n await client.pushMessage(context.secrets.LINE_USER_ID, messages)\n return { match: true }\n}\n" }, { "path": "core/src/SlackMessageUtilities.ts", "content": "import { KnownBlock, MessageAttachment } from '@slack/types'\n\nexport type SlackMessage = SlackMessageWithoutBlocks | SlackMessageWithBlocks\nexport type SlackMessageWithoutBlocks = {\n text: string\n attachments?: MessageAttachment[]\n}\nexport type SlackMessageWithBlocks = { text?: string; blocks: KnownBlock[] }\n\nexport function createErrorMessage(error: Error): SlackMessage {\n const title =\n (error.name || 'Error') + (error.message ? `: ${error.message}` : '')\n return {\n text: title,\n attachments: [\n {\n color: 'danger',\n blocks: [\n {\n type: 'section',\n text: {\n type: 'mrkdwn',\n text: ['```', String(error.stack || error), '```'].join('')\n }\n }\n ]\n }\n ]\n }\n}\n" }, { "path": "core/src/SpeedDial.ts", "content": "import { getDb } from './MongoDatabase'\nimport { AutomatronContext } from './types'\n\nasync function getCollection(context: AutomatronContext) {\n const db = await getDb(context)\n return db.collection<{ _id: string; code: string }>('speedDial')\n}\n\nexport async function saveSpeedDial(\n context: AutomatronContext,\n name: string,\n code: string\n) {\n const collection = await getCollection(context)\n await collection.updateOne(\n { _id: name },\n { $set: { code } },\n { upsert: true }\n )\n}\n\nexport async function getSpeedDialCode(\n context: AutomatronContext,\n name: string\n) {\n const collection = await getCollection(context)\n const result = await collection.findOne({ _id: name })\n if (!result) {\n throw new Error(`Speed dial ${name} not found`)\n }\n return result.code\n}\n\nexport async function getAllSpeedDials(context: AutomatronContext) {\n const collection = await getCollection(context)\n return collection.find({}).sort({ _id: 1 }).toArray()\n}\n" }, { "path": "core/src/SpendingTracking.ts", "content": "import { getDb } from './MongoDatabase'\nimport { ref } from './PersistentState'\nimport { TextMessageHandler } from './types'\n\nexport const SpendingTrackingMessageHandler: TextMessageHandler = (\n text,\n context\n) => {\n if (text === 'pace') {\n return async () => {\n const db = await getDb(context)\n const paceResetTimeRef = ref(context, 'SpendingTracking.paceResetTime')\n const paceResetTime = await paceResetTimeRef.get()\n const allowancePerMillis = 24000 / (32 * 86400e3)\n const elapsed = Date.now() - Date.parse(paceResetTime)\n const txs = await db\n .collection('txs')\n .find({ time: { $gt: paceResetTime } })\n .sort({ _id: 1 })\n .toArray()\n const warnings = []\n let sum = 0\n for (const tx of txs) {\n let currencyMul\n if (tx.currency === 'บาท') {\n currencyMul = 1\n } else {\n warnings.push(`Unknown currency ${tx.currency}`)\n continue\n }\n const typeMul = tx.type === 'refund' ? -1 : 1\n sum += tx.amount * typeMul * currencyMul\n }\n const remaining = Math.round(allowancePerMillis * elapsed - sum)\n // return { sum, warnings }\n return `used ${sum} บาท\\nremaining ${remaining} บาท`\n }\n }\n if (text === 'reset pace') {\n return async () => {\n const now = new Date().toISOString()\n await ref(context, 'SpendingTracking.paceResetTime').set(now)\n return `Pace reset to ${now}`\n }\n }\n}\n" }, { "path": "core/src/TemporaryBlobStorage.ts", "content": "import { Storage } from '@google-cloud/storage'\nimport { nanoid } from 'nanoid'\n\nconst storage = new Storage()\nlet latest: { blobName: string; buffer: Buffer } | undefined\n\nexport async function putBlob(buffer: Buffer, extension: string) {\n const blobName = nanoid() + extension\n await storage.bucket('tmpblob').file(blobName).save(buffer)\n latest = { blobName, buffer }\n return blobName\n}\n\nexport async function getBlob(blobName: string) {\n if (latest && latest.blobName === blobName) {\n return latest.buffer\n }\n const response = await storage.bucket('tmpblob').file(blobName).download()\n return response[0]\n}\n\nexport async function getBlobUrl(blobName: string) {\n const result = await storage\n .bucket('tmpblob')\n .file(blobName)\n .getSignedUrl({\n action: 'read',\n expires: new Date(Date.now() + 86400e3),\n version: 'v4',\n virtualHostedStyle: true,\n })\n return result[0]\n}\n" }, { "path": "core/src/Tracing.ts", "content": "import { AutomatronContext } from './types'\n\nexport async function trace(\n context: AutomatronContext,\n name: string,\n f: () => Promise\n) {\n const tracer = context.tracer\n if (!tracer) {\n return f()\n }\n const span = tracer.createChildSpan({ name })\n try {\n return await f()\n } finally {\n span.endSpan()\n }\n}\n" }, { "path": "core/src/TypedGristDocAPI.ts", "content": "import type { GristDocAPI } from 'grist-api'\n\n// From: https://dt.in.th/GristTypeGenerator\nexport interface TypedGristDocAPI\n extends Omit<\n GristDocAPI,\n | 'fetchTable'\n | 'addRecords'\n | 'deleteRecords'\n | 'updateRecords'\n | 'syncTable'\n > {\n fetchTable(\n tableName: TableName,\n filters?: FilterSpec\n ): Promise\n addRecords(\n tableName: TableName,\n records: Partial[]\n ): Promise\n deleteRecords(\n tableName: TableName,\n recordIds: number[]\n ): Promise\n updateRecords(\n tableName: TableName,\n records: (Partial & { id: number })[]\n ): Promise\n syncTable(\n tableName: TableName,\n records: Partial[],\n keyColIds: (keyof Tables[TableName])[],\n options?: { filters?: FilterSpec }\n ): Promise\n}\nexport type AnyTable = { [colId: string]: unknown }\nexport type AnyTables = { [table: string]: AnyTable }\nexport type FilterSpec = {\n [ColId in keyof Table]?: Table[ColId][]\n}\n" }, { "path": "core/src/bot.ts", "content": "import Encrypted from '@dtinth/encrypted'\nimport { MessageEvent, middleware, WebhookEvent } from '@line/bot-sdk'\nimport axios from 'axios'\nimport cors from 'cors'\nimport express, {\n NextFunction,\n Request,\n RequestHandler,\n Response,\n} from 'express'\nimport handler from 'express-async-handler'\nimport { claimEquals, auth as jwtAuth } from 'express-oauth2-jwt-bearer'\nimport { Stream } from 'stream'\nimport sealedbox from 'tweetnacl-sealedbox-js'\nimport { getPendingCronJobs, updateCronJob } from './Cron'\nimport { encrypt } from './DataEncryption'\nimport { checkDeviceOnlineStatus, trackDevice } from './DeviceTracking'\nimport { LINEClient } from './LINEClient'\nimport { toMessages } from './LINEMessageUtilities'\nimport { logger } from './logger'\nimport { handleImage, handleTextMessage } from './MessageHandler'\nimport { getMessageHistory } from './MessageHistory'\nimport { handleNotification } from './NotificationProcessor'\nimport { ref } from './PersistentState'\nimport { deployPrelude } from './PreludeCode'\nimport { createErrorMessage, SlackMessage } from './SlackMessageUtilities'\nimport { handleSMS } from './SMSHandler'\nimport { getAllSpeedDials } from './SpeedDial'\nimport { AutomatronContext } from './types'\n\nconst app = express()\napp.set('trust proxy', true)\n\nfunction getAutomatronContext(req: Request, res: Response): AutomatronContext {\n return {\n secrets: req.env,\n tracer: req.tracer,\n requestInfo: {\n ip: req.ip || '',\n ips: req.ips,\n headers: req.headers,\n },\n addPromise: (name, promise) => {\n if (!res.yields) res.yields = []\n res.yields.push(promise)\n },\n }\n}\n\nasync function runMiddleware(\n req: Request,\n res: Response,\n middleware: RequestHandler\n): Promise {\n return new Promise((resolve, reject) => {\n middleware(req, res, (error) => {\n if (error) {\n reject(error)\n } else {\n resolve()\n }\n })\n })\n}\n\nasync function handleWebhook(\n context: AutomatronContext,\n events: WebhookEvent[],\n client: LINEClient\n) {\n async function main() {\n for (const event of events) {\n if (event.type === 'message') {\n await handleMessageEvent(event)\n }\n }\n }\n\n async function handleMessageEvent(event: MessageEvent) {\n const { replyToken, message } = event\n if (event.source.userId !== context.secrets.LINE_USER_ID) {\n await client.replyMessage(replyToken, toMessages('unauthorized'))\n return\n }\n client.showLoadingAnimation(event.source.userId).catch((e) => {\n logger.error({ err: e }, 'Unable to show loading animation')\n })\n if (message.type === 'text') {\n const reply = await handleTextMessage(context, message.text, {\n source: 'line',\n })\n await client.replyMessage(replyToken, toMessages(reply))\n } else if (message.type === 'sticker') {\n const reply = await handleTextMessage(\n context,\n 'sticker:' + message.packageId + ':' + message.stickerId,\n { source: 'line' }\n )\n await client.replyMessage(replyToken, toMessages(reply))\n } else if (message.type === 'image') {\n const content = await client.getMessageContent(message.id)\n const buffer = await readAsBuffer(content)\n const reply = await handleImage(context, buffer as Buffer, {\n source: 'line',\n })\n await client.replyMessage(replyToken, toMessages(reply))\n } else {\n await client.replyMessage(replyToken, [\n { type: 'text', text: 'don’t know how to handle this yet!' },\n ])\n }\n }\n\n return main()\n}\n\napp.post(\n '/webhook',\n handler(async (req, res) => {\n const lineConfig = getLineConfig(req, res)\n await runMiddleware(req, res, middleware(lineConfig))\n await handleRequest(req, res, async (context, services) => {\n const lineClient = services.line\n logger.info(\n { ingest: 'line', event: JSON.stringify(req.body) },\n 'Received webhook from LINE'\n )\n const data = await handleWebhook(context, req.body.events, lineClient)\n return data\n })\n })\n)\n\napp.post(\n '/slack',\n require('body-parser').json(),\n (req, res, next) => {\n logger.info(\n { ingest: 'slack', event: JSON.stringify(req.body) },\n 'Received an event from Slack'\n )\n if (req.body.type === 'url_verification') {\n res.set('Content-Type', 'text/plain').send(req.body.challenge)\n return\n }\n next()\n },\n endpoint(async (context, req, services) => {\n if (req.body.type === 'event_callback') {\n let globalScope = global as unknown as {\n automatronSlackEventCache: Set\n }\n let eventCache = globalScope.automatronSlackEventCache\n if (!eventCache) {\n eventCache = new Set()\n globalScope.automatronSlackEventCache = eventCache\n }\n const eventId = req.body.event_id\n if (eventCache.has(eventId)) {\n return\n }\n eventCache.add(eventId)\n if (req.body.event.user === req.env.SLACK_USER_ID) {\n const text = String(req.body.event.text)\n .replace(/>/g, '>')\n .replace(/</g, '>')\n .replace(/&/g, '&')\n const slackClient = services.slack\n const reply = await handleTextMessage(context, text, {\n source: 'slack',\n })\n await slackClient.pushMessage({\n text: `\\`\\`\\`${JSON.stringify(reply, null, 2)}\\`\\`\\``,\n })\n }\n }\n\n return 1\n })\n)\n\napp.post(\n '/post',\n require('body-parser').json(),\n requireApiKey,\n endpoint(async (context, req, services) => {\n const lineClient = services.line\n const messages = toMessages(req.body.data)\n await lineClient.pushMessage(context.secrets.LINE_USER_ID, messages)\n })\n)\n\napp.post(\n '/text',\n require('body-parser').json(),\n requireApiKey,\n endpoint(async (context, req, services) => {\n logger.info(\n { ingest: 'text', event: JSON.stringify(req.body) },\n 'Received a text API call'\n )\n const text = String(req.body.text)\n logToSlack(context, services.auditSlack, text, req.body.source)\n const reply = await handleTextMessage(context, text, {\n source: 'text:' + req.body.source,\n })\n return reply\n })\n)\n\napp.options('/webpost-firebase', cors() as any)\napp.post(\n '/webpost-firebase',\n require('body-parser').json(),\n requireFirebaseAuth,\n cors(),\n endpoint(async (context, req, services) => {\n logger.info(\n { ingest: 'webpost-firebase', event: JSON.stringify(req.body) },\n 'Received a webpost API call with Firebase credentials'\n )\n const text = String(req.body.text)\n logToSlack(context, services.auditSlack, text, req.body.source)\n const reply = await handleTextMessage(context, text, {\n source: 'webpost:' + req.body.source,\n })\n return reply\n })\n)\n\napp.options('/history', cors() as any)\napp.get(\n '/history',\n requireFirebaseAuth,\n cors(),\n endpoint(async (context, req) => {\n logger.info(\n { ingest: 'history', event: JSON.stringify(req.body) },\n 'Received a history API call'\n )\n return {\n history: await getMessageHistory(context, { limit: 20 }),\n }\n })\n)\n\napp.options('/speed-dials', cors() as any)\napp.get(\n '/speed-dials',\n requireFirebaseAuth,\n cors(),\n endpoint(async (context, req) => {\n logger.info(\n { ingest: 'speed-dials', event: JSON.stringify(req.body) },\n 'Received a speed dial API call'\n )\n return {\n speedDials: await getAllSpeedDials(context),\n }\n })\n)\n\napp.options('/knobs', cors() as any)\napp.get(\n '/knobs',\n requireFirebaseAuth,\n cors(),\n endpoint(async (context, req) => {\n logger.info({ ingest: 'knobs' }, 'Received a knobs API call')\n const knobKeys = ((await ref(context, 'knobs').get()) as string).split(',')\n const knobs = Object.fromEntries(\n await Promise.all(\n knobKeys.map(async (key) => {\n const value = await ref(context, key).get()\n return [key, value] as [string, string]\n })\n )\n )\n return { knobs }\n })\n)\n\n// http post $AUTOMATRON/encrypt data=meow\napp.post(\n '/encrypt',\n express.json(),\n endpoint(async (context, req) => {\n return encrypt(context, req.body.data)\n })\n)\n\nfunction logToSlack(\n context: AutomatronContext,\n slack: Slack,\n text: string,\n source: string\n) {\n context.addPromise(\n 'Log to Slack',\n slack.pushMessage({\n blocks: [\n {\n type: 'context',\n elements: [{ type: 'plain_text', text: 'from ' + source }],\n },\n {\n type: 'section',\n text: { type: 'plain_text', text: text },\n },\n ],\n })\n )\n}\n\napp.post(\n '/gh/prelude/push',\n require('body-parser').json(),\n endpoint(async (context, req, services) => {\n logger.info(\n { ingest: 'prelude-push', event: JSON.stringify(req.body) },\n 'Received prelude push webhook from GitHub'\n )\n await deployPrelude(context)\n return 'ok'\n })\n)\n\napp.post(\n '/sms',\n require('body-parser').json(),\n requireApiKey,\n endpoint(async (context, req, services) => {\n const text = String(req.body.text)\n return await handleSMS(context, services.line, text)\n })\n)\n\napp.post(\n '/notification',\n require('body-parser').text(),\n endpoint(async (context, req, services) => {\n try {\n const encrypted = Encrypted(context.secrets.ENCRYPTION_SECRET)\n const { publicKey, secretKey } = encrypted(`\n BpnjVPJcwkInfE/lPxxcl6E11BlDNh3v.KoCet77F7KC4pvuhRySH2wNP1AjYpUGVcHQSqhc\n rbFTDHUsXDaYjF/Jc584uh7Bd6yLl0a4scdEsX7EhxuHXUknD4bA8AXxkJe/OhI3EbmfleP5\n ByVNvvvxqScM9pHvCy/bURK33REznhvW0MsscwgRGsqMxvI7Km9RpxpglexWANMlrkuVBJbC\n G3CeOqs9QGI3QS0K+jse8PM7HvJ8vg43AAjQsx6o85xSzaGWVWE1wdNtWfkdusGf/NYbDyb6\n hgA9ddrCRJVMydqJ4g9A/LgpieO0v\n `)\n const result = sealedbox.open(\n Buffer.from(req.body, 'hex'),\n Buffer.from(publicKey, 'base64'),\n Buffer.from(secretKey, 'base64')\n )\n const notification = JSON.parse(Buffer.from(result).toString('utf8'))\n logger.info(\n { ingest: 'notification', notification },\n 'Received a notification from ' + notification.packageName\n )\n const deviceId = String(req.query.deviceId ?? 'phone')\n await trackDevice(context, deviceId, {})\n await handleNotification(context, notification)\n } catch (err) {\n logger.error({ err, data: req.body }, 'Unable to process notification')\n }\n })\n)\n\napp.get(\n '/cron',\n endpoint(async (context, req, services) => {\n const otherTasks: Promise[] = []\n otherTasks.push(\n (async () => {\n await checkDeviceOnlineStatus(context)\n })()\n )\n await Promise.all(otherTasks)\n\n const pendingJobs = await getPendingCronJobs(context)\n const jobsToRun = pendingJobs.filter(\n (j) => new Date().toISOString() >= j.scheduledTime\n )\n logger.trace('Number of pending cron jobs found: %s', jobsToRun.length)\n try {\n for (const job of jobsToRun) {\n let result = 'No output'\n const logContext = {\n job: { id: job._id.toString(), name: job.name },\n }\n try {\n const reply = await handleTextMessage(context, job.name, {\n source: 'cron:' + job._id.toString(),\n })\n result = require('util').inspect(reply)\n logger.info(\n { ...logContext, result },\n `Done processing cron job: ${job.name}`\n )\n } catch (e) {\n logError('Unable to process cron job', e, logContext)\n result = `Error: ${e}`\n }\n await updateCronJob(context, job._id.toString(), {\n completed: true,\n notes: result,\n })\n }\n return 'All OK'\n } catch (e) {\n logError('Unable to process cron jobs', e)\n return 'Error: ' + e\n }\n })\n)\n\napp.post(\n '/mac/ping',\n require('body-parser').json(),\n requireApiKey,\n endpoint(async (context, req, services) => {\n const deviceId = req.body.deviceId\n if (!deviceId) {\n throw new Error('Missing deviceId')\n }\n const newState = await trackDevice(context, deviceId, {\n locked: req.body.locked || null,\n powerSource: req.body.powerSource,\n online: true,\n })\n return { newState }\n })\n)\n\nfunction requireApiKey(req: Request, res: Response, next: NextFunction) {\n const context = getAutomatronContext(req, res)\n if (req.body.key !== context.secrets.API_KEY) {\n return res.status(401).json({ error: 'Invalid API key' })\n }\n next()\n}\n\nconst firebaseAuthn = jwtAuth({\n issuer: 'https://securetoken.google.com/dtinth-automatron',\n jwksUri:\n 'https://www.googleapis.com/service_accounts/v1/jwk/securetoken@system.gserviceaccount.com',\n audience: 'dtinth-automatron',\n})\nfunction requireFirebaseAuth(req: Request, res: Response, next: NextFunction) {\n const encrypted = Encrypted(req.env.ENCRYPTION_SECRET)\n const sub = encrypted(\n `HnX5zHMDR/F7ZUy8sw2829Wi7cYbi/3c.6CBZ+I3sTbyYsXUg81qf+OvjRQExIfVkkhGvEs9E+w7LAO4y9KwU1DtKAtIutA==`\n )\n return firebaseAuthn(req, res, (err) => {\n if (err) {\n return next(err)\n }\n claimEquals('sub', sub)(req, res, next)\n })\n}\n\nclass Slack {\n constructor(private webhookUrl: string) {}\n async pushMessage(message: SlackMessage) {\n await axios.post(this.webhookUrl, message)\n }\n}\n\ninterface ThirdPartyServices {\n line: LINEClient\n slack: Slack\n auditSlack: Slack\n}\n\nfunction endpoint(\n f: (\n context: AutomatronContext,\n req: Request,\n services: ThirdPartyServices\n ) => Promise\n): RequestHandler {\n return handler(async (req, res) => {\n await handleRequest(req, res, (context, services) =>\n f(context, req, services)\n )\n })\n}\n\nasync function handleRequest(\n req: Request,\n res: Response,\n f: (context: AutomatronContext, services: ThirdPartyServices) => Promise\n) {\n const context = getAutomatronContext(req, res)\n const encrypted = Encrypted(context.secrets.ENCRYPTION_SECRET)\n const lineConfig = getLineConfig(req, res)\n const lineClient = new LINEClient(lineConfig)\n const slackClient = new Slack(context.secrets.SLACK_WEBHOOK_URL)\n const auditSlackClient = new Slack(\n encrypted(\n 'j3o0uDUL3OuYfUsYxZUkI8ECdaUIGxW0.HX1CMjS27oaZHnQormJbPIoE9xdPB3GsITBVXW2oIFeuuAb4xyWVJZyywWMubR1I1ECkXtBJN+Fs+98MECYk+u9YnlnAgw6DlE9e8TezE88C5DeNtOO0DOnSO6ww39Cn/w=='\n )\n )\n try {\n const result = await f(context, {\n line: lineClient,\n slack: slackClient,\n auditSlack: auditSlackClient,\n })\n await Promise.allSettled(res.yields || [])\n res.json({ ok: true, result })\n } catch (e) {\n logError('Unable to execute endpoint ' + req.path, e)\n try {\n await slackClient.pushMessage(createErrorMessage(e as any))\n } catch (ee) {\n console.error('Cannot send error message to LINE!')\n logError('Unable to send error message to Slack', ee)\n }\n await Promise.allSettled(res.yields || [])\n throw e\n }\n}\n\nfunction logError(title: string, e: any, extra: Record = {}) {\n var response = e.response || (e.originalError && e.originalError.response)\n var data = response && response.data\n const bindings: Record = { ...extra, err: e }\n if (data) {\n bindings.responseData = JSON.stringify(data)\n }\n logger.error(bindings, `${title}: ${e}`)\n}\n\nfunction getLineConfig(req: Request, res: Response) {\n const context = getAutomatronContext(req, res)\n const isDev = process.env.AUTOMATRON_ENV === 'dev'\n return {\n channelAccessToken: isDev\n ? context.secrets.DEV_LINE_CHANNEL_ACCESS_TOKEN\n : context.secrets.LINE_CHANNEL_ACCESS_TOKEN,\n channelSecret: isDev\n ? context.secrets.DEV_LINE_CHANNEL_SECRET\n : context.secrets.LINE_CHANNEL_SECRET,\n }\n}\n\nfunction readAsBuffer(stream: Stream) {\n return new Promise((resolve, reject) => {\n stream.on('error', (e: Error) => {\n reject(e)\n })\n const bufs: Buffer[] = []\n stream.on('end', () => {\n resolve(Buffer.concat(bufs))\n })\n stream.on('data', (buf: Buffer) => {\n bufs.push(buf)\n })\n })\n}\n\nmodule.exports = app\n" }, { "path": "core/src/logger.ts", "content": "import pino from 'pino'\n\nexport const logger = pino({\n // https://github.com/pinojs/pino/issues/726#issuecomment-605814879\n messageKey: 'message',\n formatters: {\n level: (label) => {\n function getSeverity(label: string) {\n switch (label) {\n case 'trace':\n return 'DEBUG'\n case 'debug':\n return 'DEBUG'\n case 'info':\n return 'INFO'\n case 'warn':\n return 'WARNING'\n case 'error':\n return 'ERROR'\n case 'fatal':\n return 'CRITICAL'\n default:\n return 'DEFAULT'\n }\n }\n return { severity: getSeverity(label) }\n },\n },\n}).child({ name: 'automatron' })\n" }, { "path": "core/src/modules.d.ts", "content": "declare module '@google-cloud/vision' {\n export class ImageAnnotatorClient {\n constructor(options?: any)\n documentTextDetection(\n imageBuffer: Buffer\n ): Promise<\n {\n fullTextAnnotation: {\n pages: {\n blocks: {\n paragraphs: {\n words: {\n symbols: {\n text: string\n }[]\n }[]\n }[]\n }[]\n }[]\n }\n }[]\n >\n }\n}\n\ndeclare module 'airtable' {\n export interface AirtableRecord {\n get(field: string): any\n getId(): string\n }\n export default class Airtable {\n constructor(options: any)\n base(\n id: string\n ): {\n table(\n name: string\n ): {\n select(\n options?: any\n ): {\n all(): Promise\n }\n create(data: any, options?: any): Promise\n update(id: string, data: any): Promise\n }\n }\n }\n}\n" }, { "path": "core/src/scripts/updateEnv.ts", "content": "import { Storage } from '@google-cloud/storage'\nimport { password } from '@inquirer/prompts'\nimport * as age from 'age-encryption'\nimport { defineCommand, runMain } from 'citty'\n\nconst main = defineCommand({\n meta: {\n name: 'updateEnv',\n description:\n 'Encrypt and upload environment variables to Google Cloud Storage',\n },\n args: {\n name: {\n type: 'positional',\n description: 'Name',\n required: true,\n },\n },\n async run({ args }) {\n const name = args.name\n const value = await password({\n message: `Enter value for ${name}:`,\n mask: true,\n })\n const e = new age.Encrypter()\n e.addRecipient(\n 'age1234vw9hka4p6eurluezk49kn46ywqpshywy6eypvs0kw0dep6a4sn6gyaz'\n )\n e.addRecipient(\n 'age1eeezwmr0u6pnl2rgw56dl3k5pcsmxfmzv42varg2zzm96a7s64as9cffpl'\n )\n const ciphertext = await e.encrypt(value)\n const encoded = age.armor.encode(ciphertext)\n console.log(name)\n console.log(encoded)\n\n await writeEnv(name, encoded)\n },\n})\n\nasync function writeEnv(key: string, encodedValue: string) {\n const storage = new Storage()\n const [, bucket, file] = process.env.AUTOMATRON_ENV_GS_URI!.match(\n /^gs:\\/\\/([^\\/]+)\\/(.+)$/\n )!\n const [data] = await storage.bucket(bucket).file(file).download()\n const encryptedEnv = JSON.parse(data.toString()) as Record\n encryptedEnv[key] = encodedValue\n await storage\n .bucket(bucket)\n .file(file)\n .save(JSON.stringify(encryptedEnv, null, 2))\n console.log(`Updated ${key} in ${process.env.AUTOMATRON_ENV_GS_URI}`)\n}\n\nrunMain(main)\n" }, { "path": "core/src/server.ts", "content": "import { Storage } from '@google-cloud/storage'\nimport { start } from '@google-cloud/trace-agent'\nimport * as age from 'age-encryption'\nimport crypto from 'crypto'\nimport express from 'express'\nimport 'google-application-credentials-base64'\nimport { BotSecrets } from './BotSecrets'\n\nconst bot = require('./bot')\nconst tracer = start()\n\nconst app = express()\nconst PORT = process.env.PORT || 28364\n\nconst storage = new Storage()\nconst [, bucket, file] = process.env.AUTOMATRON_ENV_GS_URI!.match(\n /^gs:\\/\\/([^\\/]+)\\/(.+)$/\n)!\n\nfunction loadEnv(): Promise {\n return storage\n .bucket(bucket)\n .file(file)\n .download()\n .then(async ([data]) => {\n const encryptedEnv = JSON.parse(data.toString()) as Record\n const env: Record = {}\n const d = new age.Decrypter()\n d.addIdentity(process.env.AGE_SECRET_KEY!)\n for (const [key, value] of Object.entries(encryptedEnv)) {\n const ciphertext = age.armor.decode(value)\n env[key] = await d.decrypt(ciphertext, 'text')\n }\n console.log('Decrypted keys:', Object.keys(env))\n return env\n }) as Promise\n}\nlet envPromise: Promise = loadEnv()\nlet reloadPromise: Promise | null = null\nenvPromise\n .then(async (env) => {\n console.log('Environment has been loaded')\n })\n .catch((err) => {\n console.error('Unable to load environment', err)\n })\napp.post('/run/automatron/reload', async (req, res, next) => {\n try {\n let validationEnv: BotSecrets\n try {\n validationEnv = await envPromise\n } catch (err) {\n console.warn('Existing environment unavailable, attempting reload', err)\n validationEnv = await loadEnv()\n }\n const providedApiKey = req.get('X-API-Key')\n const providedBuffer = providedApiKey\n ? Buffer.from(providedApiKey, 'utf8')\n : undefined\n const expectedBuffer = Buffer.from(validationEnv.API_KEY, 'utf8')\n if (\n !providedBuffer ||\n providedBuffer.length !== expectedBuffer.length ||\n !crypto.timingSafeEqual(providedBuffer, expectedBuffer)\n ) {\n res.status(401).send('Invalid API key')\n return\n }\n const startReload = () => {\n const nextEnvPromise = loadEnv()\n return nextEnvPromise\n .then((env) => {\n envPromise = nextEnvPromise\n return env\n })\n .catch((err) => {\n console.error('Unable to reload environment', err)\n throw err\n })\n .finally(() => {\n reloadPromise = null\n })\n }\n if (!reloadPromise) {\n reloadPromise = startReload()\n }\n await reloadPromise\n res.json({ ok: true })\n } catch (err) {\n next(err)\n }\n})\napp.use('/run/automatron', async (req, res, next) => {\n try {\n req.tracer = tracer\n req.env = (await envPromise) as unknown as BotSecrets\n bot(req, res)\n } catch (err) {\n next(err)\n }\n})\napp.get('/', (req, res) => {\n res.send('Automatron is running')\n})\napp.listen(PORT, () => {\n console.log(`Automatron server is running on port ${PORT}`)\n})\n" }, { "path": "core/src/typedefs.d.ts", "content": "declare module 'tweetnacl-sealedbox-js'\ndeclare module 'lib'\n" }, { "path": "core/src/types.ts", "content": "import { FlexMessage, messagingApi, TextMessage } from '@line/bot-sdk'\nimport { BotSecrets } from './BotSecrets'\nimport type { PluginTypes } from '@google-cloud/trace-agent'\nimport { IncomingHttpHeaders } from 'http'\n\nexport interface AutomatronContext {\n secrets: BotSecrets\n requestInfo: HttpRequestInfo\n tracer?: PluginTypes.Tracer\n addPromise: (name: string, promise: Promise) => void\n}\n\nexport interface HttpRequestInfo {\n ip: string\n ips: string[]\n headers: IncomingHttpHeaders\n}\n\ndeclare global {\n module Express {\n interface Request {\n env: BotSecrets\n tracer?: PluginTypes.Tracer\n }\n interface Response {\n yields?: Promise[]\n }\n }\n module NodeJS {\n interface Global {\n automatronSlackEventCache?: Set\n }\n }\n}\n\nexport { FlexMessage, TextMessage } from '@line/bot-sdk'\n\nexport type AutomatronResponse =\n | string\n | messagingApi.TextMessage\n | messagingApi.TextMessage[]\n | messagingApi.FlexMessage\n | messagingApi.FlexMessage[]\n\nexport type TextMessageHandler = (\n text: string,\n context: AutomatronContext\n) => (() => Promise) | undefined\n" }, { "path": "core/tsconfig.json", "content": "{\n \"compilerOptions\": {\n \"target\": \"es2020\",\n \"module\": \"commonjs\",\n \"noEmit\": true,\n \"lib\": [\"es2020\"],\n \"esModuleInterop\": true,\n \"strict\": true,\n \"rootDir\": \"src\",\n \"skipLibCheck\": true\n }\n}\n" }, { "path": "fnox.toml", "content": "default_provider = \"age\"\n\n[providers.age]\ntype = \"age\"\nrecipients = [\n \"ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHac2M/WdCsejGpA87JlU2uwvVokPhqD7eufdMDoEU8z\",\n \"age1234vw9hka4p6eurluezk49kn46ywqpshywy6eypvs0kw0dep6a4sn6gyaz\",\n]\n\n[secrets]\nAUTOMATRON_ENV_GS_URI = { provider = \"age\", value = \"YWdlLWVuY3J5cHRpb24ub3JnL3YxCi0+IHNzaC1lZDI1NTE5IDU1NTU1QSBuUEs0cnFxTmowMWVGNFQ1WG41NUVIKzdoUHNodjFReW0wQW9LUFNIa2hNCnZEVFNWQ1FkYmhaaGR4cnhaNnBKQTFJcmlIblo3TWxlQTRKYTVyWHBRUjgKLT4gWDI1NTE5IHhYL3dOY0hUWWNwQzV1WTg5ejM2QUdKNTdUVVNUWVJEZlFlZk8wbU9GeWsKMS96TUdIWXpxbVJOOW5JQStRSnRWMHJJeEFYQmpmeXl5UnNFU0cvUmJrSQotLS0gWmErQlZXM1J3L2FCY1JTcHExZTVYWW1aN2xvV0FaT1FNTXZ1QXRvZWR5awoMoFXvpKR5HptiKYIwCNP1Nc2QygS/o6S1c3PY6V5kdAxAku0plOQMAef1PNR/ZZOUUdcAh8Eux38Yw+Cf6ARWPXSIewIt/csh\" }\nAGE_SECRET_KEY = { provider = \"age\", value = \"YWdlLWVuY3J5cHRpb24ub3JnL3YxCi0+IHNzaC1lZDI1NTE5IDU1NTU1QSBmTjZmKy9lMzVmZDdjanE2NGttZHVtMTR0VEVQVHRMVVRTYmNLWC9DTVZZCjd2NHo5ZU5wd251NCtNd0cvNTREa3VtaCs3eXA4R2VuOVdsSUhueE1LZUEKLT4gWDI1NTE5IERleis4WFB6K2lLRC8wdjlVdTkxTDlxa01wb1BkMjJtOWc1aTU4ajY0SGcKVlpMbkRNZlZKNXFYRW9IQlBzVXl0OGlUYndCdVJMbTBzYWdMNWRlQWtrdwotLS0ga1RNaDVlVm5zUXc3cFF4UTVCMDhqS3ZjTk13bnFtd0xWcmJNeGxOSHhKMArxpe14F0CnSZsC3ULOoT+Ux+4LCbzE91ocIW15MnN6S6ltSKz7R22qN5gp5THqgb5D4wWiwgAJly6Zbi4lRr7QEXHEztHfMxKZbteRIQyFzXhpE0cijc7r9tz8fl2ZOjbBJzwe2Pxbl7b/\" }\nFRP_SERVER_ADDR = { provider = \"age\", value = \"YWdlLWVuY3J5cHRpb24ub3JnL3YxCi0+IHNzaC1lZDI1NTE5IDU1NTU1QSBITld6M2xlMS8ya1lyTW9UZEdnWVJZMnE1RDZnMzBseVEvdHZ1Y3NJeHk4Ck03c0YzOGRvQmlUckdJVk9td3V5WkxnZG93QnlKRlNtWjRiU3dZK243NzgKLT4gWDI1NTE5IDg4L2tURkdLN250VThHQVNBTUFqeHpHNG5GVDFDdGlNemZYQ3YzaGozM0EKVjU0TUJYSHVSSEdzMUxjbmdOY2srT0dBTGxuanhweGJCaWQ2MDdiSTlLRQotLS0gZkVkVXZMSXd2YlMvbFI2a1l2VGQzcmgrbHBjS0wzL3hXbXpHTzVzRWNlQQo2o4ALYA0LvVvDchUo6X6Jg6uoIlAVsT7vI9BFsWER2q8d0XQn9Kp7TzCMYl8=\" }\n" }, { "path": "frpc.toml", "content": "serverAddr = \"{{ .Envs.FRP_SERVER_ADDR }}\"\nserverPort = 7000\n\n[[proxies]]\nname = \"automatron\"\ntype = \"http\"\nlocalPort = 28364\nsubdomain = \"automatron-tunnel\"\n" }, { "path": "images/.gitkeep", "content": "\n" }, { "path": "mise.toml", "content": "[tools]\nfnox = \"latest\"\nnode = \"24\"\n\n[env]\n_.file = '.env'\n" }, { "path": "package.json", "content": "{\n \"name\": \"automatron-workspace\",\n \"private\": true,\n \"packageManager\": \"pnpm@9.7.1+sha512.faf344af2d6ca65c4c5c8c2224ea77a81a5e8859cbc4e06b1511ddce2f0151512431dd19e6aff31f2c6a8f5f2aced9bd2273e1fed7dd4de1868984059d2c4247\",\n \"engines\": {\n \"node\": \"24.x\"\n },\n \"scripts\": {\n \"dev\": \"fnox exec -- pnpm -C core run dev\",\n \"tunnel\": \"fnox exec -- frpc -c frpc.toml\",\n \"env:set\": \"fnox exec -- pnpm -C core exec tsx src/scripts/updateEnv.ts\"\n }\n}\n" }, { "path": "pnpm-workspace.yaml", "content": "packages:\n - core\n - webui\n" }, { "path": "webui/.eslintrc.cjs", "content": "/**\n * This is intended to be a basic starting point for linting in your app.\n * It relies on recommended configs out of the box for simplicity, but you can\n * and should modify this configuration to best suit your team's needs.\n */\n\n/** @type {import('eslint').Linter.Config} */\nmodule.exports = {\n root: true,\n parserOptions: {\n ecmaVersion: 'latest',\n sourceType: 'module',\n ecmaFeatures: {\n jsx: true,\n },\n },\n env: {\n browser: true,\n commonjs: true,\n es6: true,\n },\n\n // Base config\n extends: ['eslint:recommended'],\n\n overrides: [\n // React\n {\n files: ['**/*.{js,jsx,ts,tsx}'],\n plugins: ['react', 'jsx-a11y'],\n extends: [\n 'plugin:react/recommended',\n 'plugin:react/jsx-runtime',\n 'plugin:react-hooks/recommended',\n 'plugin:jsx-a11y/recommended',\n ],\n settings: {\n react: {\n version: 'detect',\n },\n formComponents: ['Form'],\n linkComponents: [\n { name: 'Link', linkAttribute: 'to' },\n { name: 'NavLink', linkAttribute: 'to' },\n ],\n 'import/resolver': {\n typescript: {},\n },\n },\n rules: {\n 'jsx-a11y/no-autofocus': 'off',\n },\n },\n\n // Typescript\n {\n files: ['**/*.{ts,tsx}'],\n plugins: ['@typescript-eslint', 'import'],\n parser: '@typescript-eslint/parser',\n settings: {\n 'import/internal-regex': '^~/',\n 'import/resolver': {\n node: {\n extensions: ['.ts', '.tsx'],\n },\n typescript: {\n alwaysTryTypes: true,\n },\n },\n },\n extends: [\n 'plugin:@typescript-eslint/recommended',\n 'plugin:import/recommended',\n 'plugin:import/typescript',\n ],\n rules: {\n '@typescript-eslint/no-unused-vars': 'off',\n 'import/no-unresolved': 'off',\n '@typescript-eslint/no-explicit-any': 'off',\n },\n },\n\n // Node\n {\n files: ['.eslintrc.js'],\n env: {\n node: true,\n },\n },\n ],\n}\n" }, { "path": "webui/.gitignore", "content": "node_modules\n\n/.cache\n/build\n.env\n/dist/" }, { "path": "webui/README.md", "content": "# Welcome to Remix + Vite!\n\n📖 See the [Remix docs](https://remix.run/docs) and the [Remix Vite docs](https://remix.run/docs/en/main/future/vite) for details on supported features.\n\n## Development\n\nRun the Vite dev server:\n\n```shellscript\nnpm run dev\n```\n\n## Deployment\n\nFirst, build your app for production:\n\n```sh\nnpm run build\n```\n\nThen run the app in production mode:\n\n```sh\nnpm start\n```\n\nNow you'll need to pick a host to deploy it to.\n\n### DIY\n\nIf you're familiar with deploying Node applications, the built-in Remix app server is production-ready.\n\nMake sure to deploy the output of `npm run build`\n\n- `build/server`\n- `build/client`\n" }, { "path": "webui/app/Clock.tsx", "content": "import { useEffect, useState } from 'react'\n\nexport function Clock() {\n const [time, setTime] = useState(getTime)\n useEffect(() => {\n const interval = setInterval(() => {\n setTime(getTime())\n }, 1000)\n return () => clearInterval(interval)\n }, [])\n return (\n
\n {time}\n
\n )\n}\nconst getTime = () => {\n return new Date().toString().split(' ')[4].split(':').slice(0, 2).join(':')\n}\n" }, { "path": "webui/app/backend.ts", "content": "import {\n getAuth,\n onAuthStateChanged,\n User,\n GoogleAuthProvider,\n signInWithPopup,\n signOut as signOutFirebase,\n} from 'firebase/auth'\nimport { getFirestore, doc, getDoc } from 'firebase/firestore'\nimport { app } from './firebase'\nimport { SyncExternalStore } from 'sync-external-store'\nimport axios from 'axios'\n\nconst auth = getAuth(app)\nconst firestore = getFirestore(app)\n\nclass AutomatronBackend implements Backend {\n authReadyStatePromise: Promise\n authStore = new SyncExternalStore(undefined)\n private url?: string\n\n constructor() {\n this.authReadyStatePromise = new Promise((resolve) => {\n onAuthStateChanged(auth, (user) => {\n this.authStore.state = user\n resolve()\n if (user && !this.url) {\n this.getUrl()\n }\n })\n })\n }\n\n private async getUrl() {\n if (this.url) {\n return this.url\n }\n const s = await getDoc(\n doc(firestore, 'apps', 'automatron', 'config', 'url')\n )\n this.url = s.data()?.service\n return this.url\n }\n\n async signIn() {\n try {\n const provider = new GoogleAuthProvider()\n await signInWithPopup(auth, provider)\n } catch (error) {\n console.error(error)\n alert(`Unable to sign in: ${error}`)\n }\n }\n\n async signOut() {\n await signOutFirebase(auth)\n }\n\n async send(text: string): Promise {\n const data = await this._post('/webpost-firebase', { text, source: 'web' })\n if (typeof data.result === 'string') {\n data.result = [\n {\n type: 'text',\n text: data.result,\n },\n ]\n }\n return data\n }\n\n private async getHeaders() {\n return {\n Authorization: `Bearer ${await this.getIdToken()}`,\n }\n }\n\n async getHistory(): Promise {\n return this._get('/history')\n }\n\n async getSpeedDials(): Promise {\n return this._get('/speed-dials')\n }\n\n async getKnobs(): Promise }>> {\n return this._get('/knobs')\n }\n\n private async getIdToken() {\n return await auth.currentUser!.getIdToken()\n }\n\n async _get(url: string) {\n const response = await axios.get((await this.getUrl()) + url, {\n headers: await this.getHeaders(),\n })\n return response.data\n }\n\n async _post(url: string, data: any) {\n const response = await axios.post((await this.getUrl()) + url, data, {\n headers: await this.getHeaders(),\n })\n return response.data\n }\n}\n\nclass FakeBackend implements Backend {\n authReadyStatePromise: Promise = Promise.resolve()\n authStore = new SyncExternalStore(null)\n\n async signIn() {\n this.authStore.state = {} as User\n }\n\n async signOut() {\n this.authStore.state = null\n }\n\n async getHistory(): Promise {\n return { ok: true, result: { history: [] } }\n }\n\n async getSpeedDials(): Promise {\n return { ok: true, result: { speedDials: [] } }\n }\n\n async getKnobs(): Promise }>> {\n return { ok: true, result: { knobs: {} } }\n }\n\n async send(text: string): Promise {\n return JSON.parse(text)\n }\n}\n\ntype Ok = { ok: true; result: X }\n\ninterface Backend {\n authReadyStatePromise: Promise\n authStore: SyncExternalStore\n signIn(): Promise\n signOut(): Promise\n send(text: string): Promise\n getHistory(): Promise\n getSpeedDials(): Promise\n getKnobs(): Promise }>>\n}\n\nexport const backend =\n typeof location === 'undefined' ||\n new URLSearchParams(location.search).get('backend') === 'fake'\n ? new FakeBackend()\n : new AutomatronBackend()\n\nif (typeof window !== 'undefined') {\n Object.assign(window, { backend })\n}\n" }, { "path": "webui/app/firebase.ts", "content": "import { initializeApp } from 'firebase/app'\n\n// Your web app's Firebase configuration\nconst firebaseConfig = {\n apiKey: 'AIzaSyAmj0axCEWY5ojSMDs25h0hNNfMFCRIqys',\n authDomain: 'dtinth-automatron.firebaseapp.com',\n projectId: 'dtinth-automatron',\n storageBucket: 'dtinth-automatron.appspot.com',\n messagingSenderId: '347735770628',\n appId: '1:347735770628:web:8fce6a02b34c2d17c2d751',\n}\n\n// Initialize Firebase\nexport const app = initializeApp(firebaseConfig)\n" }, { "path": "webui/app/index.css", "content": "@tailwind base;\n@tailwind components;\n@tailwind utilities;\n\nbody {\n font-family: Arimo, Helvetica, Arial, sans-serif;\n}\n\n.come-up {\n animation: 0.25s come-up;\n}\n\n@keyframes come-up {\n from {\n transform: scale(0.99);\n opacity: 0;\n }\n to {\n transform: scale(1);\n opacity: 1;\n }\n}\n\nbody::-webkit-scrollbar {\n display: none;\n}\n\n.bg-bevel {\n background: #252423 linear-gradient(to bottom, #454443, #151413);\n}\n\n.bg-emboss {\n background: #252423 linear-gradient(to bottom, #151413, #292827);\n}\n\n.bg-glossy {\n background: #252423\n linear-gradient(\n to bottom,\n #353433 0%,\n #252423 50%,\n #151413 50%,\n #252423 100%\n );\n}\n" }, { "path": "webui/app/requireAuth.ts", "content": "import { backend } from './backend'\nimport { redirect } from '@remix-run/react'\n\nexport async function requireAuth() {\n await backend.authReadyStatePromise\n if (!backend.authStore.state) {\n throw redirect('/')\n }\n}\n" }, { "path": "webui/app/root.tsx", "content": "import {\n Links,\n LiveReload,\n Meta,\n Outlet,\n Scripts,\n ScrollRestoration,\n} from '@remix-run/react'\n\nimport './index.css'\n\nexport default function App() {\n return (\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n )\n}\n" }, { "path": "webui/app/routes/_index.tsx", "content": "import { ReactNode, useSyncExternalStore } from 'react'\nimport { Clock } from '~/Clock'\nimport { backend } from '~/backend'\nimport { Icon } from '@iconify-icon/react'\nimport running from '@iconify-icons/cil/running'\nimport menu from '@iconify-icons/cil/menu'\nimport { useNavigate } from '@remix-run/react'\n\nexport default function Index() {\n return (\n <>\n \n \n \n )\n}\n\nfunction AuthButton() {\n const authState = useSyncExternalStore(\n backend.authStore.subscribe,\n backend.authStore.getSnapshot\n )\n const navigate = useNavigate()\n\n return (\n <>\n {authState === undefined ? (\n <>\n ) : authState === null ? (\n backend.signIn()} title=\"Sign In\">\n \n \n ) : (\n {\n navigate('/automatron')\n }}\n title=\"Automatron\"\n >\n \n \n )}\n \n \n )\n}\n\nexport interface FloatingButton {\n title: string\n children: ReactNode\n onClick?: () => void\n}\n\nexport function FloatingButton(props: FloatingButton) {\n return (\n
\n \n {props.children}\n \n
\n )\n}\n" }, { "path": "webui/app/routes/automatron._index.tsx", "content": "import { Icon } from '@iconify-icon/react'\nimport chevronLeft from '@iconify-icons/cil/chevron-left'\nimport chevronRight from '@iconify-icons/cil/chevron-right'\nimport history from '@iconify-icons/cil/history'\nimport send from '@iconify-icons/cil/send'\nimport {\n Await,\n ClientActionFunctionArgs,\n Form,\n useActionData,\n useLoaderData,\n useNavigation,\n} from '@remix-run/react'\nimport clsx from 'clsx'\nimport { ReactNode, Suspense, useState } from 'react'\nimport { z } from 'zod'\nimport { backend } from '~/backend'\nimport { requireAuth } from '~/requireAuth'\n\nexport const clientLoader = async () => {\n await requireAuth()\n return {\n speedDialsPromise: backend.getSpeedDials(),\n historyPromise: backend.getHistory(),\n }\n}\n\nexport interface ActionResult {\n result?: unknown\n error?: unknown\n}\n\nexport const clientAction = async (\n args: ClientActionFunctionArgs\n): Promise => {\n await requireAuth()\n const form = await args.request.formData()\n const text = form.get('text')\n const result = await backend.send(String(text))\n try {\n return { result } as ActionResult\n } catch (error) {\n return { error }\n }\n}\n\nconst classes = {\n button:\n 'bg-bevel hover:border-#555453 block rounded border border-#454443 p-2 shadow-md shadow-black/50 active:border-#8b8685 flex flex-col items-center justify-center',\n}\n\nexport default function AutomatronConsole() {\n const data = useLoaderData()\n const [speedDialEnabled, setSpeedDialEnabled] = useState(false)\n const [historyEnabled, setHistoryEnabled] = useState(false)\n const { error, result } = useActionData() ?? {}\n const navigation = useNavigation()\n const isSubmitting = navigation.state === 'submitting'\n\n return (\n <>\n
\n \n \n \n \n \n
\n setHistoryEnabled((x) => !x)}\n >\n \n \n setSpeedDialEnabled((x) => !x)}\n >\n \n \n {speedDialEnabled && (\n Loading...
}>\n \n {(speedDials) => }\n \n \n )}\n \n {historyEnabled && (\n
\n \n Loading...
}>\n \n {(historyData) => (\n \n )}\n \n \n \n \n )}\n
\n {!!isSubmitting && (\n 
\n            Sending...\n
\n )}\n {!!error && (\n 
\n            {String(error)}\n
\n )}\n {!!result && }\n
\n \n )\n}\n\nexport interface OutputViewer {\n data: unknown\n}\n\ntype OkResult = z.infer\nconst OkResult = z.object({\n ok: z.literal(true),\n result: z.array(\n z\n .object({\n type: z.string(),\n })\n .passthrough()\n ),\n})\n\nexport function OutputViewer(props: OutputViewer) {\n const { data } = props\n const okResult = OkResult.safeParse(data)\n if (okResult.success) {\n const result = okResult.data.result\n return (\n
\n {result.map((item, index) => (\n \n ))}\n
\n )\n }\n return (\n 
\n      {typeof data === 'string' ? data : JSON.stringify(data, null, 2)}\n
\n )\n}\n\ntype ResultEntry = { type: 'text'; text: string }\n\nexport interface ResultItem {\n item: ResultEntry\n}\n\nexport function ResultItem(props: ResultItem) {\n const { item } = props\n const children = (() => {\n switch (item.type) {\n case 'text':\n return 
{item.text}
\n default:\n return (\n 
\n            {JSON.stringify(item, null, 2)}\n
\n )\n }\n })()\n return (\n
\n {children}\n
\n )\n}\n\nexport interface AutomatronHistory {\n historyData: any\n}\nexport function AutomatronHistory(props: AutomatronHistory) {\n return (\n <>\n
\n {props.historyData.result.history.map(\n (item: { text: string }, index: number) => (\n \n 
\n                {item.text}\n
\n
\n )\n )}\n \n \n )\n}\n\nexport interface Panel {\n title: ReactNode\n children: ReactNode\n}\n\nexport function Panel(props: Panel) {\n return (\n
\n

\n {props.title}\n

\n {props.children}\n
\n )\n}\n\nexport interface SpeedDial {\n speedDialData: any\n}\nexport function SpeedDial(props: SpeedDial) {\n return (\n <>\n {props.speedDialData.result.speedDials.map((item: { _id: string }) => (\n
\n \n \n \n ))}\n \n )\n}\n" }, { "path": "webui/app/routes/automatron.knobs.tsx", "content": "import { Icon } from '@iconify-icon/react'\nimport copy from '@iconify-icons/cil/copy'\nimport { useLoaderData } from '@remix-run/react'\nimport { backend } from '~/backend'\nimport { requireAuth } from '~/requireAuth'\n\nexport interface AutomatronKnobs {}\n\nexport const clientLoader = async () => {\n await requireAuth()\n return {\n knobs: await backend.getKnobs(),\n }\n}\n\nexport default function AutomatronKnobs() {\n const { knobs } = useLoaderData()\n return (\n
\n {Object.entries(knobs.result.knobs)\n .sort((a, b) => a[0].localeCompare(b[0]))\n .map(([name, value]) => {\n return (\n
\n
\n \n {\n const code = `;;ref('${name}').set(${JSON.stringify(\n value\n )})`\n navigator.clipboard.writeText(code)\n }}\n >\n \n \n
\n \n
\n )\n })}\n
\n )\n}\n" }, { "path": "webui/app/routes/automatron.tsx", "content": "import { Link, Outlet, useLocation } from '@remix-run/react'\nimport { Fragment } from 'react'\n\nexport default function AutomatronLayout() {\n const { pathname } = useLocation()\n return (\n <>\n
\n {Array.from(['automatron', 'knobs']).map((key) => {\n const to = `/automatron${key === 'automatron' ? '' : `/${key}`}`\n return (\n \n {pathname === to ? (\n
\n {key}\n
\n ) : (\n \n {key}\n \n )}\n \n )\n })}\n
\n
\n \n
\n \n )\n}\n" }, { "path": "webui/env.d.ts", "content": "/// \n/// \n" }, { "path": "webui/package.json", "content": "{\n \"name\": \"webui-remix\",\n \"private\": true,\n \"sideEffects\": false,\n \"type\": \"module\",\n \"scripts\": {\n \"build\": \"remix vite:build\",\n \"dev\": \"remix vite:dev --port ${PORT:-22301}\",\n \"lint\": \"eslint --ignore-path .gitignore --cache --cache-location ./node_modules/.cache/eslint .\",\n \"start\": \"remix-serve ./build/server/index.js\",\n \"typecheck\": \"tsc\"\n },\n \"dependencies\": {\n \"@fontsource/arimo\": \"^5.0.18\",\n \"@iconify-icon/react\": \"^1.0.8\",\n \"@iconify-icons/cil\": \"^1.2.4\",\n \"@nanostores/react\": \"^0.7.1\",\n \"@playwright/test\": \"^1.40.1\",\n \"@remix-run/node\": \"^2.12.0\",\n \"@remix-run/react\": \"^2.12.0\",\n \"@remix-run/serve\": \"^2.12.0\",\n \"axios\": \"^1.6.5\",\n \"clsx\": \"^1.2.1\",\n \"firebase\": \"^10.7.1\",\n \"isbot\": \"^4.1.0\",\n \"nanostores\": \"^0.9.5\",\n \"react\": \"^18.2.0\",\n \"react-dom\": \"^18.2.0\",\n \"sync-external-store\": \"^1.0.0\",\n \"zod\": \"^3.20.2\"\n },\n \"devDependencies\": {\n \"@remix-run/dev\": \"^2.12.0\",\n \"@types/react\": \"^18.2.47\",\n \"@types/react-dom\": \"^18.2.18\",\n \"@typescript-eslint/eslint-plugin\": \"^6.7.4\",\n \"autoprefixer\": \"^10.4.13\",\n \"eslint\": \"^8.38.0\",\n \"eslint-config-prettier\": \"^9.0.0\",\n \"eslint-import-resolver-typescript\": \"^3.6.1\",\n \"eslint-plugin-import\": \"^2.28.1\",\n \"eslint-plugin-jsx-a11y\": \"^6.7.1\",\n \"eslint-plugin-react\": \"^7.33.2\",\n \"eslint-plugin-react-hooks\": \"^4.6.0\",\n \"postcss\": \"^8.4.33\",\n \"tailwindcss\": \"^3.4.1\",\n \"typescript\": \"^5.9.3\",\n \"vite\": \"^5.0.0\",\n \"vite-tsconfig-paths\": \"^4.2.1\"\n },\n \"engines\": {\n \"node\": \"24.x\"\n }\n}\n" }, { "path": "webui/playwright-report/index.html", "content": "\n\n\n\n \n \n \n \n Playwright Test Report\n \n \n \n \n
\n \n \n\n" }, { "path": "webui/playwright.config.ts", "content": "import type { PlaywrightTestConfig } from '@playwright/test'\nimport { devices } from '@playwright/test'\n\n/**\n * Read environment variables from file.\n * https://github.com/motdotla/dotenv\n */\n// require('dotenv').config();\n\n/**\n * See https://playwright.dev/docs/test-configuration.\n */\nconst config: PlaywrightTestConfig = {\n testDir: './tests',\n /* Maximum time one test can run for. */\n timeout: 30 * 1000,\n expect: {\n /**\n * Maximum time expect() should wait for the condition to be met.\n * For example in `await expect(locator).toHaveText();`\n */\n timeout: 5000,\n },\n /* Run tests in files in parallel */\n fullyParallel: true,\n /* Fail the build on CI if you accidentally left test.only in the source code. */\n forbidOnly: !!process.env.CI,\n /* Retry on CI only */\n retries: process.env.CI ? 2 : 0,\n /* Opt out of parallel tests on CI. */\n workers: process.env.CI ? 1 : undefined,\n /* Reporter to use. See https://playwright.dev/docs/test-reporters */\n reporter: 'html',\n /* Shared settings for all the projects below. See https://playwright.dev/docs/api/class-testoptions. */\n use: {\n /* Maximum time each action such as `click()` can take. Defaults to 0 (no limit). */\n actionTimeout: 0,\n /* Base URL to use in actions like `await page.goto('/')`. */\n baseURL: 'http://localhost:22301',\n\n /* Collect trace when retrying the failed test. See https://playwright.dev/docs/trace-viewer */\n trace: 'on-first-retry',\n },\n\n /* Configure projects for major browsers */\n projects: [\n {\n name: 'chromium',\n use: {\n ...devices['Desktop Chrome'],\n },\n },\n\n // {\n // name: 'firefox',\n // use: {\n // ...devices['Desktop Firefox'],\n // },\n // },\n\n // {\n // name: 'webkit',\n // use: {\n // ...devices['Desktop Safari'],\n // },\n // },\n\n /* Test against mobile viewports. */\n // {\n // name: 'Mobile Chrome',\n // use: {\n // ...devices['Pixel 5'],\n // },\n // },\n // {\n // name: 'Mobile Safari',\n // use: {\n // ...devices['iPhone 12'],\n // },\n // },\n\n /* Test against branded browsers. */\n // {\n // name: 'Microsoft Edge',\n // use: {\n // channel: 'msedge',\n // },\n // },\n // {\n // name: 'Google Chrome',\n // use: {\n // channel: 'chrome',\n // },\n // },\n ],\n\n /* Folder for test artifacts such as screenshots, videos, traces, etc. */\n // outputDir: 'test-results/',\n\n /* Run your local dev server before starting the tests */\n // webServer: {\n // command: 'npm run start',\n // port: 3000,\n // },\n}\n\nexport default config\n" }, { "path": "webui/postcss.config.cjs", "content": "module.exports = {\n plugins: {\n tailwindcss: {},\n autoprefixer: {},\n },\n}\n" }, { "path": "webui/tailwind.config.cjs", "content": "/** @type {import('tailwindcss').Config} */\nmodule.exports = {\n content: ['./index.html', './app/**/*.{js,ts,jsx,tsx}'],\n theme: {\n extend: {\n colors: {\n '#e9e8e7': '#e9e8e7',\n '#8b8685': '#8b8685',\n '#656463': '#656463',\n '#454443': '#454443',\n '#353433': '#353433',\n '#252423': '#252423',\n '#090807': '#090807',\n '#bbeeff': '#bbeeff',\n '#d7fc70': '#d7fc70',\n '#ffffbb': '#ffffbb',\n },\n },\n },\n plugins: [],\n}\n" }, { "path": "webui/tests/automatron.spec.ts", "content": "import { test, expect, Page } from '@playwright/test'\n\ntest('shows current time', async ({ page }) => {\n await page.goto('/')\n await expect(page.locator('body')).toHaveText(/\\d\\d:\\d\\d/)\n})\n\ntest('can sign in', async ({ page }) => {\n await page.goto('/?backend=fake')\n await page.getByRole('button', { name: 'Sign In' }).click()\n await expect(page.getByRole('button', { name: 'Automatron' })).toBeVisible()\n})\n\ntest('can send message with error', async ({ page }) => {\n await page.goto('/?backend=fake')\n await page.getByRole('button', { name: 'Sign In' }).click()\n await page.getByRole('button', { name: 'Automatron' }).click()\n await page.getByRole('textbox').fill('!error')\n await page.getByRole('button', { name: 'Send' }).click()\n await expect(page.locator('pre')).toHaveText(/SyntaxError/)\n})\n\ntest('can display result', async ({ page }) => {\n await send(page, {\n type: 'text',\n text: 'Hello, world!',\n })\n await expect(page.locator('pre')).toHaveText(/Hello, world!/)\n})\n\nasync function send(page: Page, ...results: any[]) {\n await page.goto('/?backend=fake')\n await page.getByRole('button', { name: 'Sign In' }).click()\n await page.getByRole('button', { name: 'Automatron' }).click()\n await page.getByRole('textbox').fill(\n JSON.stringify({\n ok: true,\n result: [...results],\n })\n )\n await page.getByRole('button', { name: 'Send' }).click()\n}\n" }, { "path": "webui/tsconfig.json", "content": "{\n \"include\": [\"env.d.ts\", \"**/*.ts\", \"**/*.tsx\"],\n \"compilerOptions\": {\n \"lib\": [\"DOM\", \"DOM.Iterable\", \"ES2022\"],\n \"isolatedModules\": true,\n \"esModuleInterop\": true,\n \"jsx\": \"react-jsx\",\n \"module\": \"ESNext\",\n \"moduleResolution\": \"Bundler\",\n \"resolveJsonModule\": true,\n \"target\": \"ES2022\",\n \"strict\": true,\n \"allowJs\": true,\n \"skipLibCheck\": true,\n \"forceConsistentCasingInFileNames\": true,\n \"baseUrl\": \".\",\n \"paths\": {\n \"~/*\": [\"./app/*\"]\n },\n\n // Vite takes care of building everything, not tsc.\n \"noEmit\": true\n }\n}\n" }, { "path": "webui/vercel.json", "content": "{\n \"routes\": [\n { \"handle\": \"filesystem\" },\n { \"src\": \"/(.*)\", \"dest\": \"/index.html\" }\n ]\n}\n" }, { "path": "webui/vite.config.ts", "content": "import { vitePlugin as remix } from '@remix-run/dev'\nimport { defineConfig } from 'vite'\nimport tsconfigPaths from 'vite-tsconfig-paths'\n\nexport default defineConfig({\n plugins: [remix({ ssr: false, buildDirectory: 'dist' }), tsconfigPaths()],\n})\n" } ]