[ { "path": ".circleci/config.yml", "content": "version: 2\n\nworkflows:\n version: 2\n chromeless:\n jobs:\n - build_node_6\n - build_node_8\n - release:\n requires:\n - build_node_6\n - build_node_8\n filters:\n branches:\n only: master\n\nrestore_cache: &restore_cache\n restore_cache:\n keys:\n - npm-cache-{{ checksum \"package-lock.json\" }}\n\nsave_cache: &save_cache\n save_cache:\n key: npm-cache-{{ checksum \"package-lock.json\" }}\n paths:\n - ~/.npm\n\ncodecov: &codecov\n run:\n name: Codecov\n command: node_modules/.bin/nyc report --reporter=json && bash <(curl -s https://codecov.io/bash) -f coverage/coverage-final.json\n\njobs:\n # Build, lint, run tests\n build_node_6:\n working_directory: ~/chromeless\n docker:\n - image: circleci/node:6\n - image: yukinying/chrome-headless-browser\n steps:\n - run: node -v; npm -v\n - checkout\n - *restore_cache\n - run: npm install\n - *save_cache\n - run: npm test\n - *codecov\n build_node_8:\n working_directory: ~/chromeless\n docker:\n - image: circleci/node:8\n - image: yukinying/chrome-headless-browser\n steps:\n - run: node -v; npm -v\n - checkout\n - *restore_cache\n - run: npm install\n - *save_cache\n - run: npm test\n - *codecov\n\n # On master and if tests passed, parse the commit history to see if a new release should happen\n # If yes, publish to npm and tag a release on GitHub\n release:\n working_directory: ~/chromeless\n docker:\n - image: circleci/node:8\n steps:\n - run: node -v; npm -v\n - checkout\n - *restore_cache\n - run: npm install\n - *save_cache\n - run: npm run build\n - run: npm run semantic-release\n" }, { "path": ".editorconfig", "content": "\n[*]\nindent_size = 2\nindent_style = space\ninsert_final_newline = true\ncharset = utf-8\ntrim_trailing_whitespace = true\nend_of_line = lf\n" }, { "path": ".github/ISSUE_TEMPLATE.md", "content": "\n\n# This is a (Bug Report / Feature Proposal)\n\n## Description\n\nFor bug reports:\n* What went wrong?\n* What did you expect should have happened?\n* What was the config you used?\n* What stacktrace or error message from your provider did you see?\n\nFor feature proposals:\n* What is the use case that should be solved. The more detail you describe this in the easier it is to understand for us.\n* If there is a new API method, how would it look\n\nSimilar or dependent issues:\n* #12345\n\n## Additional Data\n\n* ***Chromeless Version you're using***:\n* ***Operating System***:\n* ***Stack Trace***:\n* ***Error messages***:\n" }, { "path": ".github/PULL_REQUEST_TEMPLATE.md", "content": "\n\n- [ ] If this PR is a new feature, reference an issue where a consensus about the design was reached (not necessary for small changes)\n- [ ] Make sure all of the significant new logic is covered by tests\n- [ ] Rebase your changes on master so that they can be merged easily\n- [ ] Make sure all tests and linter rules pass\n- [ ] If you've changed APIs, update the documentation in [README](/) and [/api/README](/api/README.md)\n" }, { "path": ".gitignore", "content": "node_modules\ndist\n.idea\n*.log\n.DS_Store\n.serverless\n.build\n.envrc\n.nyc_output/\ncoverage/\nyarn.lock\n" }, { "path": ".prettierignore", "content": ".nyc_output/\n*.md\ndist/\npackage.json\npackage-lock.json\nserverless/\n" }, { "path": ".prettierrc", "content": "{\n \"semi\": false,\n \"singleQuote\": true,\n \"trailingComma\": \"all\"\n}\n" }, { "path": "CODE_OF_CONDUCT.md", "content": "# Contributor Covenant Code of Conduct\n\n## Our Pledge\n\nIn the interest of fostering an open and welcoming environment, we as contributors and maintainers pledge to making participation in our project and our community a harassment-free experience for everyone, regardless of age, body size, disability, ethnicity, gender identity and expression, level of experience, nationality, personal appearance, race, religion, or sexual identity and orientation.\n\n## Our Standards\n\nExamples of behavior that contributes to creating a positive environment include:\n\n* Using welcoming and inclusive language\n* Being respectful of differing viewpoints and experiences\n* Gracefully accepting constructive criticism\n* Focusing on what is best for the community\n* Showing empathy towards other community members\n\nExamples of unacceptable behavior by participants include:\n\n* The use of sexualized language or imagery and unwelcome sexual attention or advances\n* Trolling, insulting/derogatory comments, and personal or political attacks\n* Public or private harassment\n* Publishing others' private information, such as a physical or electronic address, without explicit permission\n* Other conduct which could reasonably be considered inappropriate in a professional setting\n\n## Our Responsibilities\n\nProject maintainers are responsible for clarifying the standards of acceptable behavior and are expected to take appropriate and fair corrective action in response to any instances of unacceptable behavior.\n\nProject maintainers have the right and responsibility to remove, edit, or reject comments, commits, code, wiki edits, issues, and other contributions that are not aligned to this Code of Conduct, or to ban temporarily or permanently any contributor for other behaviors that they deem inappropriate, threatening, offensive, or harmful.\n\n## Scope\n\nThis Code of Conduct applies both within project spaces and in public spaces when an individual is representing the project or its community. Examples of representing a project or community include using an official project e-mail address, posting via an official social media account, or acting as an appointed representative at an online or offline event. Representation of a project may be further defined and clarified by project maintainers.\n\n## Enforcement\n\nInstances of abusive, harassing, or otherwise unacceptable behavior may be reported by contacting the project team at marco.luethy@gmail.com. The project team will review and investigate all complaints, and will respond in a way that it deems appropriate to the circumstances. The project team is obligated to maintain confidentiality with regard to the reporter of an incident. Further details of specific enforcement policies may be posted separately.\n\nProject maintainers who do not follow or enforce the Code of Conduct in good faith may face temporary or permanent repercussions as determined by other members of the project's leadership.\n\n## Attribution\n\nThis Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4, available at [http://contributor-covenant.org/version/1/4][version]\n\n[homepage]: http://contributor-covenant.org\n[version]: http://contributor-covenant.org/version/1/4/\n\n" }, { "path": "CONTRIBUTING.md", "content": "# Contributing to this project\n\n[fork]: https://github.com/graphcool/chromeless/fork\n[pr]: https://github.com/graphcool/chromeless/compare\n[code-of-conduct]: CODE_OF_CONDUCT.md\n\nHi there! We're thrilled that you'd like to contribute to this project. Your help is essential for keeping it great.\n\nPlease note that this project is released with a [Contributor Code of Conduct][code-of-conduct]. By participating in this project you agree to abide by its terms.\n\n## Contribution Agreement\n\nAs a contributor, you represent that the code you submit is your original work or that of your employer (in which case you represent you have the right to bind your employer). By submitting code, you (and, if applicable, your employer) are licensing the submitted code to the open source community subject to the MIT license.\n\n\n## Submitting a pull request\n\n0. [Fork][fork] and clone the repository\n0. Create a new branch: `git checkout -b feature/my-new-feature-name`\n0. Run `npm install` to make sure you've got the latest dependencies.\n0. Make your change\n0. Run the unit tests and make sure they pass and have 100% coverage. (`npm test`)\n0. Push to your fork and [submit a pull request][pr]\n0. Pat your self on the back and wait for your pull request to be reviewed and merged.\n\nHere are a few things you can do that will increase the likelihood of your pull request being accepted:\n\n- Keep your change as focused as possible. If there are multiple changes you would like to make that are not dependent upon each other, consider submitting them as separate pull requests.\n- Make your commit message follow [Conventional Commits](https://conventionalcommits.org/).\n- In your pull request description, provide as much detail as possible. This context helps the reviewer to understand the motivation for and impact of the change.\n- Make sure that all the unit tests still pass. PRs with failing tests won't be merged.\n\n## Resources\n\n- [How to Contribute to Open Source](https://opensource.guide/how-to-contribute/)\n- [Contributing to Open Source on GitHub](https://guides.github.com/activities/contributing-to-open-source/)\n- [Using Pull Requests](https://help.github.com/articles/about-pull-requests/)\n- [GitHub Help](https://help.github.com)\n" }, { "path": "LICENSE", "content": "MIT License\n\nCopyright (c) 2017 Contributors et.al.\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.\n" }, { "path": "README.md", "content": "*This project is deprecated in favor for [Puppeteer](https://github.com/GoogleChrome/puppeteer). \nThanks to all the contributors who made this project possible.*\n\n# Chromeless\n\n[![npm](https://img.shields.io/npm/v/chromeless.svg)](https://npmjs.com/package/chromeless)\n[![downloads](https://img.shields.io/npm/dm/chromeless.svg)](https://npmjs.com/package/chromeless)\n[![circleci](https://circleci.com/gh/prismagraphql/chromeless.svg?style=shield)](https://circleci.com/gh/prismagraphql/workflows/chromeless/tree/master)\n[![codecov](https://codecov.io/gh/prismagraphql/chromeless/branch/master/graph/badge.svg)](https://codecov.io/gh/prismagraphql/chromeless)\n[![dependencies](https://david-dm.org/prismagraphql/chromeless/status.svg)](https://david-dm.org/prismagraphql/chromeless)\n[![node](https://img.shields.io/node/v/chromeless.svg)]()\n[![semantic-release](https://img.shields.io/badge/%20%20%F0%9F%93%A6%F0%9F%9A%80-semantic--release-e10079.svg)](https://github.com/semantic-release/semantic-release)\n\nChrome automation made simple. Runs locally or headless on AWS Lambda. (**[See Demo](https://chromeless.netlify.com/)**)\n\n## Chromeless can be used to...\n\n* Run 1000s of **browser integration tests in parallel** ⚡️\n* Crawl the web & automate screenshots\n* Write bots that require a real browser\n* *Do pretty much everything you've used __PhantomJS, NightmareJS or Selenium__ for before*\n\n### Examples\n\n* [JSON of Google Results](examples/extract-google-results.js): Google for `chromeless` and get a list of JSON results\n* [Screenshot of Google Results](examples/google-screenshot.js): Google for `chromeless` and take a screenshot of the results\n* [prep](https://github.com/prismagraphql/prep): Compile-time prerendering for SPA/PWA (like React, Vue...) instead of server-side rendering (SSR)\n* *See the full [examples list](/examples) for more*\n\n## ▶️ Try it out\n\nYou can try out Chromeless and explore the API in the browser-based **[demo playground](https://chromeless.netlify.com/)** ([source](https://github.com/prismagraphql/chromeless-playground)).\n\n[![](http://i.imgur.com/i1gtCzy.png)](https://chromeless.netlify.com/)\n\n## Contents\n1. [How it works](#how-it-works)\n1. [Installation](#installation)\n1. [Usage](#usage)\n1. [API Documentation](#api-documentation)\n1. [Configuring Development Environment](#configuring-development-environment)\n1. [FAQ](#faq)\n1. [Contributors](#contributors)\n1. [Credits](#credits)\n1. [Help & Community](#help-and-community)\n\n## How it works\n\nWith Chromeless you can control Chrome (open website, click elements, fill out forms...) using an [elegant API](docs/api.md). This is useful for integration tests or any other scenario where you'd need to script a real browser.\n\n### There are 2 ways to use Chromeless\n\n1. Running Chrome on your local computer\n2. Running Chrome on AWS Lambda and controlling it remotely\n\n![](http://imgur.com/2bgTyAi.png)\n\n### 1. Local Setup\n\nFor local development purposes where a fast feedback loop is necessary, the easiest way to use Chromeless is by controlling your local Chrome browser. Just follow the [usage guide](#usage) to get started.\n\n### 2. Remote Proxy Setup\n\nYou can also run Chrome in [headless-mode](https://developers.google.com/web/updates/2017/04/headless-chrome) on AWS Lambda. This way you can speed up your tests by running them in parallel. (In [Graphcool](https://www.graph.cool/)'s case this decreased test durations from ~20min to a few seconds.)\n\nChromeless comes out of the box with a remote proxy built-in - the usage stays completely the same. This way you can write and run your tests locally and have them be executed remotely on AWS Lambda. The proxy connects to Lambda through a Websocket connection to forward commands and return the evaluation results.\n\n## Installation\n```sh\nnpm install chromeless\n```\n\n### Proxy Setup\n\nThe project contains a [Serverless](https://serverless.com/) service for running and driving Chrome remotely on AWS Lambda.\n\n1. Deploy The Proxy service to AWS Lambda. More details [here](serverless#setup)\n2. Follow the usage instructions [here](serverless#using-the-proxy).\n\n\n## Usage\n\nUsing Chromeless is similar to other browser automation tools. For example:\n\n```js\nconst { Chromeless } = require('chromeless')\n\nasync function run() {\n const chromeless = new Chromeless()\n\n const screenshot = await chromeless\n .goto('https://www.google.com')\n .type('chromeless', 'input[name=\"q\"]')\n .press(13)\n .wait('#resultStats')\n .screenshot()\n\n console.log(screenshot) // prints local file path or S3 url\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n```\n\n### Local Chrome Usage\n\nTo run Chromeless locally, you need a recent version of Chrome or Chrome Canary installed (version 60 or greater). By default, chromeless will start Chrome automatically and will default to the most recent version found on your system if there's multiple. You can override this behavior by starting Chrome yourself, and passing a flag of `launchChrome: false` in the `Chromeless` constructor.\n\nTo launch Chrome yourself, and open the port for chromeless, follow this example:\n\n```sh\nalias canary=\"/Applications/Google\\ Chrome\\ Canary.app/Contents/MacOS/Google\\ Chrome\\ Canary\"\ncanary --remote-debugging-port=9222\n```\n\nOr run Chrome Canary headless-ly:\n\n```sh\ncanary --remote-debugging-port=9222 --disable-gpu --headless\n```\n\nOr run Chrome headless-ly on Windows:\n\n```sh\ncd \"C:\\Program Files (x86)\\Google\\Chrome\\Application\"\nchrome --remote-debugging-port=9222 --disable-gpu --headless\n```\n\n### Proxy Usage\n\nFollow the setup instructions [here](serverless#installation).\n\nThen using Chromeless with the Proxy service is the same as running it locally with the exception of the `remote` option.\nAlternatively you can configure the Proxy service's endpoint with environment variables. [Here's how](serverless#using-the-proxy).\n```js\nconst chromeless = new Chromeless({\n remote: {\n endpointUrl: 'https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev',\n apiKey: 'your-api-key-here',\n },\n})\n```\n\n## API Documentation\n\n**Chromeless constructor options**\n- [`new Chromeless(options: ChromelessOptions)`](docs/api.md#chromeless-constructor-options)\n\n**Chromeless methods**\n- [`end()`](docs/api.md#api-end)\n\n**Chrome methods**\n- [`goto(url: string, timeout?: number)`](docs/api.md#api-goto)\n- [`setUserAgent(useragent: string)`](docs/api.md#api-setUserAgent)\n- [`click(selector: string, x?: number, y?: number)`](docs/api.md#api-click)\n- [`wait(timeout: number)`](docs/api.md#api-wait-timeout)\n- [`wait(selector: string)`](docs/api.md#api-wait-selector)\n- [`wait(fn: (...args: any[]) => boolean, ...args: any[])`] - Not implemented yet\n- [`clearCache()`](docs/api.md#api-clearcache)\n- [`clearStorage(origin: string, storageTypes: string)`](docs/api.md#api-clearstorage)\n- [`focus(selector: string)`](docs/api.md#api-focus)\n- [`press(keyCode: number, count?: number, modifiers?: any)`](docs/api.md#api-press)\n- [`type(input: string, selector?: string)`](docs/api.md#api-type)\n- [`back()`](docs/api.md#api-back) - Not implemented yet\n- [`forward()`](docs/api.md#api-forward) - Not implemented yet\n- [`refresh()`](docs/api.md#api-refresh) - Not implemented yet\n- [`mousedown(selector: string)`](docs/api.md#api-mousedown)\n- [`mouseup(selector: string)`](docs/api.md#api-mouseup)\n- [`scrollTo(x: number, y: number)`](docs/api.md#api-scrollto)\n- [`scrollToElement(selector: string)`](docs/api.md#api-scrolltoelement)\n- [`setHtml(html: string)`](docs/api.md#api-sethtml)\n- [`setExtraHTTPHeaders(headers: Headers)`](docs/api.md#api-setextrahttpheaders)\n- [`setViewport(options: DeviceMetrics)`](docs/api.md#api-setviewport)\n- [`evaluate(fn: (...args: any[]) => void, ...args: any[])`](docs/api.md#api-evaluate)\n- [`inputValue(selector: string)`](docs/api.md#api-inputvalue)\n- [`exists(selector: string)`](docs/api.md#api-exists)\n- [`screenshot(selector: string, options: ScreenshotOptions)`](docs/api.md#api-screenshot)\n- [`pdf(options?: PdfOptions)`](docs/api.md#api-pdf)\n- [`html()`](docs/api.md#api-html)\n- [`cookies()`](docs/api.md#api-cookies)\n- [`cookies(name: string)`](docs/api.md#api-cookies-name)\n- [`cookies(query: CookieQuery)`](docs/api.md#api-cookies-query) - Not implemented yet\n- [`allCookies()`](docs/api.md#api-all-cookies)\n- [`setCookies(name: string, value: string)`](docs/api.md#api-setcookies)\n- [`setCookies(cookie: Cookie)`](docs/api.md#api-setcookies-one)\n- [`setCookies(cookies: Cookie[])`](docs/api.md#api-setcookies-many)\n- [`deleteCookies(name: string)`](docs/api.md#api-deletecookies)\n- [`clearCookies()`](docs/api.md#api-clearcookies)\n- [`clearInput(selector: string)`](docs/api.md#api-clearInput)\n- [`setFileInput(selector: string, files: string | string[])`](docs/api.md#api-set-file-input)\n\n## Configuring Development Environment\n\n**Requirements:**\n- NodeJS version 8.2 and greater\n\n1) Clone this repository\n2) Run `npm install`\n3) To build: `npm run build`\n\n#### Linking this NPM repository\n\n1) Go to this repository locally\n2) Run `npm link`\n3) Go to the folder housing your chromeless scripts\n4) Run `npm link chromeless`\n\nNow your local chromeless scripts will use your local development of chromeless.\n\n## FAQ\n\n### How is this different from [NightmareJS](https://github.com/segmentio/nightmare), PhantomJS or Selenium?\n\nThe `Chromeless` API is very similar to NightmareJS as their API is pretty awesome. The big difference is that `Chromeless` is based on Chrome in [headless-mode](https://developers.google.com/web/updates/2017/04/headless-chrome), and runs in a serverless function in AWS Lambda. The advantage of this is that you can run hundreds of browsers in parallel, without having to think about parallelisation. Running integration Tests for example is much faster.\n\n### I'm new to AWS Lambda, is this still for me?\n\nYou still can use this locally without Lambda, so yes. Besides that, here is a [simple guide](https://github.com/prismagraphql/chromeless/tree/master/serverless) on how to set the lambda function up for `Chromeless`.\n\n### How much does it cost to run Chromeless in production?\n\n> The compute price is $0.00001667 per GB-s and the free tier provides 400,000 GB-s. The request price is $0.20 per 1 million requests and the free tier provides 1M requests per month.\n\nThis means you can easily execute > 100.000 tests for free in the free tier.\n\n### Are there any limitations?\n\nIf you're running Chromeless on AWS Lambda, the execution cannot take longer than 5 minutes which is the current limit of Lambda. Besides that, every feature that's supported in Chrome is also working with Chromeless. The maximal number of concurrent function executions is 1000. [AWS API Limits](http://docs.aws.amazon.com/lambda/latest/dg/limits.html)\n\n### Are there commercial options?\n\nAlthough Chromeless is the easiest way to get started running Chrome on Lambda, you may not have time to build and manage your own visual testing toolkit. Commercial options include:\n\n* [Chromatic](http://chromaticqa.com): Visual snapshot regression testing for [Storybook](https://storybook.js.org/).\n\n## Troubleshooting\n### Error: Unable to get presigned websocket URL and connect to it.\nIn case you get an error like this when running the Chromeless client:\n```\n{ HTTPError: Response code 403 (Forbidden)\n at stream.catch.then.data (/code/chromeless/node_modules/got/index.js:182:13)\n at process._tickDomainCallback (internal/process/next_tick.js:129:7)\n name: 'HTTPError',\n...\nError: Unable to get presigned websocket URL and connect to it.\n```\nMake sure that you're running at least version `1.19.0` of [`serverless`](https://github.com/serverless/serverless). It is a known [issue](https://github.com/serverless/serverless/issues/2450), that the API Gateway API keys are not setup correctly in older Serverless versions. Best is to run `npm run deploy` within the project as this will use the local installed version of `serverless`.\n\n### Resource ServerlessDeploymentBucket does not exist for stack chromeless-serverless-dev\nIn case the deployment of the serverless function returns an error like this:\n```\n Serverless Error ---------------------------------------\n\n Resource ServerlessDeploymentBucket does not exist for stack chromeless-serverless-dev\n```\nPlease check, that there is no stack with the name `chromeless-serverless-dev` existing yet, otherwise serverless can't correctly provision the bucket.\n\n### No command gets executed\nIn order for the commands to be processed, make sure, that you call one of the commands `screenshot`, `evaluate`, `cookiesGetAll` or `end` at the end of your execution chain.\n\n## Contributors\n\nA big thank you to all contributors and supporters of this repository 💚\n\n\n \"joelgriffith\"\n\n\n \"adieuadieu\"\n\n\n \"schickling\"\n\n\n \"timsuchanek\"\n\n\n\n\n \"Chrisgozd\"\n\n\n \"criticalbh\"\n\n\n \"d2s\"\n\n\n \"emeth-\"\n\n\n \"githubixx\"\n\n\n \"hax\"\n\n\n \"Hazealign\"\n\n\n \"joeyvandijk\"\n\n\n \"liady\"\n\n\n \"matthewmueller\"\n\n\n \"seangransee\"\n\n\n \"sorenbs\"\n\n\n \"toddwprice\"\n\n\n \"vladgolubev\"\n\n\n\n\n\n## Credits\n\n* [chrome-remote-interface](https://github.com/cyrus-and/chrome-remote-interface): Chromeless uses this package as an interface to Chrome\n* [serverless-chrome](https://github.com/adieuadieu/serverless-chrome): Compiled Chrome binary that runs on AWS Lambda (Azure and GCP soon, too.)\n* [NightmareJS](https://github.com/segmentio/nightmare): We draw a lot of inspiration for the API from this great tool\n\n\n\n\n## Help & Community [![Slack Status](https://slack.graph.cool/badge.svg)](https://slack.graph.cool)\n\nJoin our [Slack community](http://slack.graph.cool/) if you run into issues or have questions. We love talking to you!\n\n

\"Prisma\"

\n" }, { "path": "docs/api.md", "content": "# API Documentation\n\nChromeless provides TypeScript typings.\n\n### Chromeless constructor options\n\n`new Chromeless(options: ChromelessOptions)`\n\n- `debug: boolean` Show debug output — Default: `false`\n- `remote: boolean` Use remote chrome process — Default: `false`\n- `implicitWait: boolean` Wait for element to exist before executing commands — Default: `false`\n- `waitTimeout: number` Time in ms to wait for element to appear — Default: `10000`\n- `scrollBeforeClick: boolean` Scroll to element before clicking, usefull if element is outside of viewport — Default: `false`\n- `viewport: any` Viewport dimensions — Default: `{width: 1440, height: 900, scale: 1}`\n- `launchChrome: boolean` Auto-launch chrome (local) — Default: `true`\n- `cdp: CDPOptions` Chome Debugging Protocol Options — Default: `{host: 'localhost', port: 9222, secure: false, closeTab: true}`\n\n### Chromeless methods\n- [`end()`](#api-end)\n\n### Chrome methods\n- [`goto(url: string, timeout?: number)`](#api-goto)\n- [`setUserAgent(useragent: string)`](#api-setuseragent)\n- [`click(selector: string, x?: number, y?: number)`](#api-click)\n- [`wait(timeout: number)`](#api-wait-timeout)\n- [`wait(selector: string, timeout?: number)`](#api-wait-selector)\n- [`wait(fn: (...args: any[]) => boolean, ...args: any[])`] - Not implemented yet\n- [`clearCache()`](#api-clearcache)\n- [`clearStorage(origin: string, storageTypes: string)`](docs/api.md#api-clearstorage)\n- [`focus(selector: string)`](#api-focus)\n- [`press(keyCode: number, count?: number, modifiers?: any)`](#api-press)\n- [`type(input: string, selector?: string)`](#api-type)\n- [`back()`](#api-back) - Not implemented yet\n- [`forward()`](#api-forward) - Not implemented yet\n- [`refresh()`](#api-refresh) - Not implemented yet\n- [`mousedown(selector: string)`](#api-mousedown)\n- [`mouseup(selector: string)`](#api-mouseup)\n- [`scrollTo(x: number, y: number)`](#api-scrollto)\n- [`scrollToElement(selector: string)`](#api-scrolltoelement)\n- [`setHtml(html: string)`](#api-sethtml)\n- [`setViewport(options: DeviceMetrics)`](#api-setviewport)\n- [`evaluate(fn: (...args: any[]) => void, ...args: any[])`](#api-evaluate)\n- [`inputValue(selector: string)`](#api-inputvalue)\n- [`exists(selector: string)`](#api-exists)\n- [`screenshot(selector: string, options: ScreenshotOptions)`](#api-screenshot)\n- [`pdf(options?: PdfOptions)`](#api-pdf)\n- [`html()`](#api-html)\n- [`cookies()`](#api-cookies)\n- [`cookies(name: string)`](#api-cookies-name)\n- [`cookies(query: CookieQuery)`](#api-cookies-query) - Not implemented yet\n- [`allCookies()`](#api-all-cookies)\n- [`setCookies(name: string, value: string)`](#api-setcookies)\n- [`setCookies(cookie: Cookie)`](#api-setcookies-one)\n- [`setCookies(cookies: Cookie[])`](#api-setcookies-many)\n- [`deleteCookies(name: string)`](#api-deletecookies)\n- [`clearCookies()`](#api-clearcookies)\n\n\n---------------------------------------\n\n\n\n### end(): Promise\n\nEnd the Chromeless session. Locally this will disconnect from Chrome. Over the Proxy, this will end the session, terminating the Lambda function.\nIt returns the last value that has been evaluated.\n\n```js\nawait chromeless.end()\n```\n\n---------------------------------------\n\n\n\n### goto(url: string, timeout?: number): Chromeless\n\nNavigate to a URL.\n\n__Arguments__\n- `url` - URL to navigate to\n- `timeout` -How long to wait for page to load (default is value of waitTimeout option)\n\n__Example__\n\n```js\nawait chromeless.goto('https://google.com/')\n```\n\n---------------------------------------\n\n\n\n### setUserAgent(useragent: string): Chromeless\n\nSet the useragent of the browser. It should be called before `.goto()`.\n\n__Arguments__\n- `useragent` - UserAgent to use\n\n__Example__\n\n```js\nawait chromeless.setUserAgent('Custom Chromeless UserAgent x.x.x')\n```\n\n---------------------------------------\n\n\n\n### click(selector: string, x?: number, y?: number): Chromeless\n\nClick on something in the DOM.\n\n__Arguments__\n- `selector` - DOM selector for element to click\n- `x` - Offset from the left of the element, default width/2\n- `y` - Offset from the top of the element, default height/2\n\n__Example__\n\n```js\nawait chromeless.click('#button')\nawait chromeless.click('#button', 20, 100)\n```\n\n---------------------------------------\n\n\n\n### wait(timeout: number): Chromeless\n\nWait for some duration. Useful for waiting for things download.\n\n__Arguments__\n- `timeout` - How long to wait, in ms\n\n__Example__\n\n```js\nawait chromeless.wait(1000)\n```\n\n---------------------------------------\n\n\n\n### wait(selector: string, timeout?: number): Chromeless\n\nWait until something appears. Useful for waiting for things to render.\n\n__Arguments__\n- `selector` - DOM selector to wait for\n- `timeout` - How long to wait for element to appear (default is value of waitTimeout option)\n\n__Example__\n\n```js\nawait chromeless.wait('div#loaded')\nawait chromeless.wait('div#loaded', 1000)\n```\n\n---------------------------------------\n\n\n\n### wait(fn: (...args: any[]) => boolean, ...args: any[]): Chromeless\n\nNot implemented yet\n\nWait until a function returns. You can also return some Promise that will be resolved at some point.\n\n__Arguments__\n- `fn` - Function to wait for\n- `[arguments]` - Arguments to pass to the function\n\n__Example__\n\n```js\nawait chromeless.wait(() => {\n return new Promise((resolve, reject) => {\n // do something async, setTimeout...\n resolve();\n });\n})\n```\n\n---------------------------------------\n\n\n\n### clearCache(): Chromeless\n\nClears browser cache.\n\nService workers and Storage (IndexedDB, WebSQL, etc) needs to be cleared separately. More information at the [Chrome Devtools Protocol website](https://chromedevtools.github.io/devtools-protocol/tot).\n\n__Example__\n\n```js\nawait chromeless.clearCache()\n```\n\n---------------------------------------\n\n\n\n### clearStorage(origin: string, storageTypes: string): Chromeless\n\nClears browser storage.\n\n__Arguments__\n- `origin` - Security origin for the storage type we wish to clear\n\n- `storageTypes` - A string comma separated list of chrome storage types. Allowed values include: appcache, cookies, file_systems, indexeddb, local_storage, shader_cache, websql, service_workers, cache_storage, all, other. More information at the [Chrome Devtools Protocol website](https://chromedevtools.github.io/devtools-protocol/tot/Storage/).\n\n__Example__\n\n```js\nawait chromeless.clearStorage('http://localhost', 'local_storage, websql')\n\nawait chromeless.clearStorage('*', 'all')\n```\n\n---------------------------------------\n\n\n\n### focus(selector: string): Chromeless\n\nProvide focus on a DOM element.\n\n__Arguments__\n- `selector` - DOM selector to focus\n\n__Example__\n\n```js\nawait chromeless.focus('input#searchField')\n```\n\n---------------------------------------\n\n\n\n### press(keyCode: number, count?: number, modifiers?: any): Chromeless\n\nSend a key press. Enter, for example.\n\n__Arguments__\n- `keyCode` - Key code to send\n- `count` - How many times to send the key press\n- `modifiers` - Modifiers to send along with the press (e.g. control, command, or alt)\n\n__Example__\n\n```js\nawait chromeless.press(13)\n```\n\n---------------------------------------\n\n\n\n### type(input: string, selector?: string): Chromeless\n\nType something (into a field, for example).\n\n__Arguments__\n- `input` - String to type\n- `selector` - DOM element to type into\n\n__Example__\n\n```js\nconst result = await chromeless\n .goto('https://www.google.com')\n .type('chromeless', 'input[name=\"q\"]')\n```\n\n---------------------------------------\n\n\n\n### back() - Not implemented yet\n\nNot implemented yet\n\n---------------------------------------\n\n\n\n### forward() - Not implemented yet\n\nNot implemented yet\n\n---------------------------------------\n\n\n\n### refresh() - Not implemented yet\n\nNot implemented yet\n\n---------------------------------------\n\n\n\n### mousedown(selector: string): Chromeless\n\nSend mousedown event on something in the DOM.\n\n__Arguments__\n- `selector` - DOM selector for element to send mousedown event\n\n__Example__\n\n```js\nawait chromeless.mousedown('#item')\n```\n\n---------------------------------------\n\n\n\n### mouseup(selector: string): Chromeless\n\nSend mouseup event on something in the DOM.\n\n__Arguments__\n- `selector` - DOM selector for element to send mouseup event\n\n__Example__\n\n```js\nawait chromeless.mouseup('#placeholder')\n```\n\n---------------------------------------\n\n\n\n### scrollTo(x: number, y: number): Chromeless\n\nScroll to somewhere in the document.\n\n__Arguments__\n- `x` - Offset from the left of the document\n- `y` - Offset from the top of the document\n\n__Example__\n\n```js\nawait chromeless.scrollTo(0, 500)\n```\n\n---------------------------------------\n\n\n\n### scrollToElement(selector: string): Chromeless\n\nScroll to location of element. Behavior is simiar to `` — target element will be at the top of viewport\n\n__Arguments__\n- `selector` - DOM selector for element to scroll to\n\n__Example__\n\n ```js\nawait chromeless.scrollToElement('.button')\n ```\n\n ---------------------------------------\n\n\n\n### setHtml(html: string): Chromeless\n\nSets given markup as the document's HTML.\n\n__Arguments__\n- `html` - HTML to set as the document's markup.\n\n__Example__\n\n```js\nawait chromeless.setHtml('

Hello world!

')\n```\n\n ---------------------------------------\n\n\n\n### setExtraHTTPHeaders(headers: Headers): Chromeless\n\nSets extra HTTP headers.\n\n__Arguments__\n- `headers` - headers as keys / values of JSON object\n\n__Example__\n\n```js\nawait chromeless.setExtraHTTPHeaders({\n 'accept-language': 'en-US,en;q=0.8'\n})\n```\n\n\n---------------------------------------\n\n\n\n### setViewport(options:DeviceMetrics)\n\nResize the viewport. Useful if you want to capture more or less of the document in a screenshot.\n\n__Arguments__\n- `options` - DeviceMetrics object\n\n__Example__\n\n```js\nawait chromeless.setViewport({width: 1024, height: 600, scale: 1})\n```\n\n---------------------------------------\n\n\n\n### evaluate(fn: (...args: any[]) => void, ...args: any[]): Chromeless\n\nEvaluate Javascript code within Chrome in the context of the DOM. Returns the resulting value or a Promise.\n\n__Arguments__\n- `fn` - Function to evaluate within Chrome, can be async (Promise).\n- `[arguments]` - Arguments to pass to the function\n\n__Example__\n\n```js\nawait chromeless.evaluate(() => {\n // this will be executed in Chrome\n const links = [].map.call(\n document.querySelectorAll('.g h3 a'),\n a => ({title: a.innerText, href: a.href})\n )\n return JSON.stringify(links)\n })\n```\n\n---------------------------------------\n\n\n\n### inputValue(selector: string): Chromeless\n\nGet the value of an input field.\n\n__Arguments__\n- `selector` - DOM input element\n\n__Example__\n\n```js\nawait chromeless.inputValue('input#searchField')\n```\n\n---------------------------------------\n\n\n\n### exists(selector: string): Chromeless\n\nTest if a DOM element exists in the document.\n\n__Arguments__\n- `selector` - DOM element to check for\n\n__Example__\n\n```js\nawait chromeless.exists('div#ready')\n```\n\n---------------------------------------\n\n\n\n### screenshot(selector: string, options: ScreenshotOptions): Chromeless\n\nTake a screenshot of the document as framed by the viewport or of a specific element (by a selector).\nWhen running Chromeless locally this returns the local file path to the screenshot image.\nWhen run over the Chromeless Proxy service, a URL to the screenshot on S3 is returned.\n\n__Arguments__\n- `selector` - DOM element to take a screenshot of,\n- `options` - An options object with the following props\n- `options.filePath` - A file path override in case of working locally\n- `options.omitBackground` - Boolean to remove default white background\n\n__Examples__\n\n```js\nconst screenshot = await chromeless\n .goto('https://google.com/')\n .screenshot()\n\nconsole.log(screenshot) // prints local file path or S3 URL\n```\n\n```js\nconst screenshot = await chromeless\n .goto('https://google.com/')\n .screenshot('#hplogo', { filePath: path.join(__dirname, 'google-logo.png') })\n\nconsole.log(screenshot) // prints local file path or S3 URL\n```\n\n```js\nconst screenshot = await chromeless\n .goto('https://google.com/')\n .screenshot({ filePath: path.join(__dirname, 'google-search.png') })\n\nconsole.log(screenshot) // prints local file path or S3 URL\n```\n\n---------------------------------------\n\n\n\n### pdf(options?: PdfOptions) - Chromeless\n\nPrint to a PDF of the document as framed by the viewport.\nWhen running Chromeless locally this returns the local file path to the PDF.\nWhen run over the Chromeless Proxy service, a URL to the PDF on S3 is returned.\n\nRequires that Chrome be running headless-ly. [More](https://github.com/graphcool/chromeless/issues/146)\n\n\n__Arguments__\n- `options` - An object containing overrides for [printToPDF() parameters](https://chromedevtools.github.io/devtools-protocol/tot/Page/#method-printToPDF)\n\n__Example__\n\n```js\nconst pdf = await chromeless\n .goto('https://google.com/')\n .pdf({landscape: true})\n\nconsole.log(pdf) // prints local file path or S3 URL\n```\n\n---------------------------------------\n\n\n\n### html(): Chromeless\n\nGet full HTML of the loaded page.\n\n__Example__\n\n```js\nconst html = await chromeless\n .setHtml('

Hello world!

')\n .html()\n\nconsole.log(html) //

Hello world!

\n```\n\n---------------------------------------\n\n\n\n### cookies(): Chromeless\n\nReturns all browser cookies for the current URL.\n\n__Example__\n\n```js\nawait chromeless.cookies()\n```\n\n---------------------------------------\n\n\n\n### cookies(name: string): Chromeless\n\nReturns a specific browser cookie by name for the current URL.\n\n__Arguments__\n- `name` - Name of the cookie to get\n\n__Example__\n\n```js\nconst cookie = await chromeless.cookies('creepyTrackingCookie')\n```\n\n---------------------------------------\n\n\n\n### cookies(query: CookieQuery) - Not implemented yet\n\nNot implemented yet\n\n---------------------------------------\n\n\n\n### allCookies(): Chromeless\n\nReturns all browser cookies. Nam nom nom.\n\n__Example__\n\n```js\nawait chromeless.allCookies()\n```\n\n---------------------------------------\n\n\n\n### setCookies(name: string, value: string): Chromeless\n\nSets a cookie with the given name and value.\n\n__Arguments__\n- `name` - Name of the cookie\n- `value` - Value of the cookie\n\n__Example__\n\n```js\nawait chromeless.setCookies('visited', '1')\n```\n\n---------------------------------------\n\n\n\n### setCookies(cookie: Cookie): Chromeless\n\nSets a cookie with the given cookie data; may overwrite equivalent cookies if they exist.\n\n__Arguments__\n- `cookie` - The cookie data to set\n\n__Example__\n\n```js\nawait chromeless.setCookies({\n url: 'http://google.com/',\n domain: 'google.com',\n name: 'userData',\n value: '{}',\n path: '/',\n expires: 0,\n size: 0,\n httpOnly: false,\n secure: true,\n session: true,\n})\n```\n\n---------------------------------------\n\n\n\n### setCookies(cookies: Cookie[]): Chromeless\n\nSets many cookies with the given cookie data; may overwrite equivalent cookies if they exist.\n\n__Arguments__\n- `url` - URL to navigate to\n\n__Example__\n\n```js\nawait chromeless.setCookies([\n {\n url: 'http://google.com/',\n domain: 'google.com',\n name: 'userData',\n value: '{}',\n path: '/',\n expires: 0,\n size: 0,\n httpOnly: false,\n secure: true,\n session: true,\n }, {\n url: 'http://bing.com/',\n domain: 'bing.com',\n name: 'userData',\n value: '{}',\n path: '/',\n expires: 0,\n size: 0,\n httpOnly: false,\n secure: true,\n session: true,\n }\n])\n```\n\n---------------------------------------\n\n\n\n### deleteCookies(name: string) - Not implemented yet\n\nDelete a specific cookie.\n\n__Arguments__\n- `name` - name of the cookie\n\n__Example__\n\n```js\nawait chromeless.deleteCookies('cookieName')\n```\n\n---------------------------------------\n\n\n\n### clearCookies(): Chromeless\n\nClears all browser cookies.\n\n__Example__\n\n```js\nawait chromeless.clearCookies()\n```\n---------------------------------------\n\n\n\n### clearInput(selector: string): Chromeless\n\nClear input text.\n\n\n__Example__\n\n```js\nawait chromeless.clearInput('#username')\n```\n---------------------------------------\n\n\n\n### setFileInput(selector: string, files: string | string[]): Chromeless\n\nSet file(s) for selected file input.\n\nCurrently not supported in the Proxy. Progress tracked in [#186](https://github.com/graphcool/chromeless/issues/186)\n\n\n__Example__\n\n```js\nawait chromeless.setFileInput('.uploader', '/User/Me/Documents/img.jpg')\n```\n" }, { "path": "examples/extract-google-results.js", "content": "const { Chromeless } = require('chromeless')\n\nasync function run() {\n const chromeless = new Chromeless({ remote: true })\n\n const links = await chromeless\n .goto('https://www.google.com')\n .type('chromeless', 'input[name=\"q\"]')\n .press(13)\n .wait('#resultStats')\n .evaluate(() => {\n // this will be executed in headless chrome\n const links = [].map.call(\n document.querySelectorAll('.g h3 a'),\n a => ({title: a.innerText, href: a.href})\n )\n return JSON.stringify(links)\n })\n // you can still use the method chaining API after evaluating\n // when you're done, at any time you can call `.then` (in our case `await`)\n .scrollTo(0, 1000)\n\n console.log(links)\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n" }, { "path": "examples/google-pdf.js", "content": "const { Chromeless } = require('chromeless')\n\nasync function run() {\n const chromeless = new Chromeless()\n\n const pdf = await chromeless\n .goto('https://www.google.com')\n .type('chromeless', 'input[name=\"q\"]')\n .press(13)\n .wait('#resultStats')\n .pdf({ displayHeaderFooter: true, landscape: true })\n\n console.log(pdf) // prints local file path or S3 url\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n" }, { "path": "examples/google-screenshot.js", "content": "const { Chromeless } = require('chromeless')\n\nasync function run() {\n const chromeless = new Chromeless()\n\n const screenshot = await chromeless\n .goto('https://www.google.com')\n .type('chromeless', 'input[name=\"q\"]')\n .press(13)\n .wait('#resultStats')\n .screenshot()\n\n console.log(screenshot) // prints local file path or S3 url\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n" }, { "path": "examples/mocha-chai-test-example.js", "content": "const { Chromeless } = require('chromeless')\nconst { expect } = require('chai')\n\n// make sure you do npm i chai\n// to run this example just run\n// mocha path/to/this/file\n\ndescribe('When searching on google', function () {\n it('shows results', async function () {\n this.timeout(10000); //we need to increase the timeout or else mocha will exit with an error\n const chromeless = new Chromeless()\n\n await chromeless.goto('https://google.com')\n .wait('input[name=\"q\"]')\n .type('chromeless github', 'input[name=\"q\"]')\n .press(13) // press enter\n .wait('#resultStats')\n\n\n const result = await chromeless.exists('a[href*=\"graphcool/chromeless\"]')\n\n\n expect(result).to.be.true\n await chromeless.end()\n })\n})\n\ndescribe('When clicking on the image of the demo playground', function () {\n it('should redirect to the demo', async function () {\n this.timeout(10000); //we need to increase the timeout or else mocha will exit with an error\n const chromeless = new Chromeless()\n await chromeless.goto('https://github.com/graphcool/chromeless')\n .wait('a[href=\"https://chromeless.netlify.com/\"]')\n .click('a[href=\"https://chromeless.netlify.com/\"]')\n .wait('#root')\n\n\n const url = await chromeless.evaluate(url => window.location.href)\n\n\n expect(url).to.match(/^https\\:\\/\\/chromeless\\.netlify\\.com/)\n await chromeless.end()\n })\n})\n" }, { "path": "examples/mouse-event-example.js", "content": "const { Chromeless } = require('chromeless')\n\nasync function run() {\n const chromeless = new Chromeless()\n\n const screenshot = await chromeless\n .goto('https://www.google.com')\n .mousedown('input[name=\"btnI\"]')\n .mouseup('input[name=\"btnI\"]')\n .wait('.latest-doodle')\n .screenshot()\n\n console.log(screenshot)\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n" }, { "path": "examples/twitter.js", "content": "const { Chromeless } = require('chromeless')\n\nconst twitterUsername = \"xxx\"\nconst twitterPassword = \"xxx\"\n\nasync function run() {\n const chromeless = new Chromeless()\n\n const screenshot = await chromeless\n .goto('https://twitter.com/login/')\n .type(twitterUsername, '.js-username-field')\n .type(twitterPassword, '.js-password-field')\n .click('button[type=\"submit\"]')\n .wait('.status')\n .screenshot()\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n\n" }, { "path": "package.json", "content": "{\n \"name\": \"chromeless\",\n \"version\": \"1.4.0\",\n \"description\": \"🖥 Chrome automation made simple. Runs locally or headless on AWS Lambda.\",\n \"homepage\": \"https://github.com/graphcool/chromeless\",\n \"license\": \"MIT\",\n \"repository\": {\n \"type\": \"git\",\n \"url\": \"https://github.com/graphcool/chromeless.git\"\n },\n \"bug\": {\n \"url\": \"https://github.com/graphcool/chromeless/issues\"\n },\n \"main\": \"dist/src/index.js\",\n \"typings\": \"dist/src/index.d.ts\",\n \"files\": [\n \"dist\"\n ],\n \"engines\": {\n \"node\": \">= 6.10.0\"\n },\n \"scripts\": {\n \"ava\": \"tsc -d && nyc ava\",\n \"build\": \"npm run clean && tsc -d\",\n \"clean\": \"rimraf dist\",\n \"coverage\": \"npm run ava\",\n \"precommit\": \"lint-staged\",\n \"commitmsg\": \"commitlint -e $GIT_PARAMS\",\n \"prettier\": \"prettier --list-different --write \\\"**/*.{ts,json}\\\"\",\n \"test\": \"npm run lint && npm run ava\",\n \"lint\": \"npm run prettier && npm run tslint\",\n \"tslint\": \"tslint -c tslint.json -p tsconfig.json --exclude 'node_modules/**'\",\n \"watch\": \"tsc -w\",\n \"watch:test\": \"tsc -d -w & ava --watch\",\n \"semantic-release\": \"semantic-release\"\n },\n \"dependencies\": {\n \"aws-sdk\": \"^2.177.0\",\n \"bluebird\": \"^3.5.1\",\n \"chrome-launcher\": \"^0.10.0\",\n \"chrome-remote-interface\": \"^0.25.5\",\n \"cuid\": \"^2.1.0\",\n \"form-data\": \"^2.3.1\",\n \"got\": \"^8.0.0\",\n \"mqtt\": \"^2.15.0\"\n },\n \"devDependencies\": {\n \"@commitlint/config-conventional\": \"^7.0.0\",\n \"@types/bluebird\": \"^3.5.19\",\n \"@types/cuid\": \"^1.3.0\",\n \"@types/node\": \"^10.0.3\",\n \"ava\": \"^0.25.0\",\n \"commitlint\": \"^7.0.0\",\n \"husky\": \"^0.14.3\",\n \"lint-staged\": \"^7.0.0\",\n \"nyc\": \"^12.0.2\",\n \"prettier\": \"1.11.1\",\n \"rimraf\": \"^2.6.2\",\n \"semantic-release\": \"^15.0.2\",\n \"tslint\": \"^5.8.0\",\n \"typescript\": \"^2.6.2\"\n },\n \"commitlint\": {\n \"extends\": [\n \"@commitlint/config-conventional\"\n ]\n },\n \"lint-staged\": {\n \"*.{ts}\": [\n \"prettier --parser typescript --no-semi --single-quote --trailing-comma all --write\",\n \"tslint\",\n \"git add\"\n ],\n \"*.{js}\": [\n \"prettier --no-semi --single-quote --trailing-comma all --write\",\n \"lint\",\n \"git add\"\n ]\n }\n}\n" }, { "path": "serverless/README.md", "content": "# Chromeless Proxy service\n\nA [Serverless](https://serverless.com/) AWS Lambda service for running and interacting with Chrome remotely with Chromeless.\n\n\n## Contents\n1. [Setup](#setup)\n1. [Using the Proxy](#using-the-proxy)\n\n\n## Setup\n\nClone this repository and enter the `serverless` directory:\n\n```bash\ngit clone https://github.com/graphcool/chromeless.git\ncd chromeless/serverless\nnpm install\n```\n\n### Configure\n\nNext, modify the `custom` section in `serverless.yml`.\n\nYou must set `awsIotHost` to the your AWS IoT Custom Endpoint for your AWS region. You can find this with the AWS CLI with `aws iot describe-endpoint --output text` or by navigating to the AWS IoT Console and going to Settings.\n\nFor example:\n\n```yaml\n...\n\ncustom:\n stage: dev\n debug: \"*\" # false if you don't want noise in CloudWatch\n awsIotHost: ${env:AWS_IOT_HOST}\n\n...\n```\n\nYou may also need to change the region in the `provider` section in `serverless.yml`:\n\n\n```yaml\n...\n\nprovider:\n name: aws\n runtime: nodejs6.10\n stage: ${self:custom.stage}\n region: YOUR_REGION_HERE\n\n...\n```\n\n**Note:** The AWS Lambda function, API Gateway and IoT must all be in the _same_ region.\n\n**Note:** Deploying from Windows is currently not supported. See [#70](https://github.com/graphcool/chromeless/issues/70#issuecomment-318634457)\n\n\n### Credentials\n\nBefore you can deploy, you must configure your AWS credentials either by defining `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` environmental variables, or using an AWS profile. You can read more about this on the [Serverless Credentials Guide](https://serverless.com/framework/docs/providers/aws/guide/credentials/).\n\nIn short, either:\n\n```bash\nexport AWS_PROFILE=\n```\n\nor\n\n```bash\nexport AWS_ACCESS_KEY_ID=\nexport AWS_SECRET_ACCESS_KEY=\n```\n\n### Deploy\n\nOnce configured, deploying the service can be done with:\n\n```bash\nnpm run deploy\n```\n\nOnce completed, some service information will be logged. Make note of the `session` GET endpoint and the value of the `dev-chromeless-session-key` API key. You'll need them when using Chromeless through the Proxy.\n\n```log\nService Information\nservice: chromeless-serverless\nstage: dev\nregion: eu-west-1\napi keys:\n dev-chromeless-session-key: X-your-api-key-here-X\nendpoints:\n GET - https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev/version\n OPTIONS - https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev/\n GET - https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev/\nfunctions:\n run: chromeless-serverless-dev-run\n version: chromeless-serverless-dev-version\n session: chromeless-serverless-dev-session\n disconnect: chromeless-serverless-dev-disconnect\n```\n\n\n## Using the Proxy\n\nConnect to the proxy service with the `remote` option parameter on the Chromeless constructor. You must provide the endpoint URL provided during deployment either as an argument or set it in the `CHROMELESS_ENDPOINT_URL` environment variable. Note that this endpoint is _different_ from the AWS IoT Custom Endpoint. The Proxy's endpoint URL you want to use will look something like `https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev/`\n\n\n### Option 1: Environment Variables\n\n```bash\nexport CHROMELESS_ENDPOINT_URL=https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev\nexport CHROMELESS_ENDPOINT_API_KEY=your-api-key-here\n```\nand\n```js\nconst chromeless = new Chromeless({\n remote: true,\n})\n```\n\n### Option 2: Constructor options\n\n```js\nconst chromeless = new Chromeless({\n remote: {\n endpointUrl: 'https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev',\n apiKey: 'your-api-key-here',\n },\n})\n```\n\n\n### Full Example\n\n```js\nconst Chromeless = require('chromeless').default\n\nasync function run() {\n const chromeless = new Chromeless({\n remote: {\n endpointUrl: 'https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev',\n apiKey: 'your-api-key-here'\n },\n })\n\n const screenshot = await chromeless\n .goto('https://www.google.com')\n .type('chromeless', 'input[name=\"q\"]')\n .press(13)\n .wait('#resultStats')\n .screenshot()\n\n console.log(screenshot) // prints local file path or S3 url\n\n await chromeless.end()\n}\n\nrun().catch(console.error.bind(console))\n```\n" }, { "path": "serverless/package.json", "content": "{\n \"name\": \"chromeless-remotechrome-service\",\n \"version\": \"1.3.0\",\n \"description\": \"The Chromeless Proxy AWS Lambda service\",\n \"homepage\": \"https://github.com/graphcool/chromeless\",\n \"license\": \"MIT\",\n \"engines\": {\n \"node\": \">= 6.10.0\"\n },\n \"scripts\": {\n \"deploy\": \"serverless deploy\"\n },\n \"dependencies\": {\n \"aws4\": \"^1.6.0\",\n \"chromeless\": \"^1.3.0\",\n \"cuid\": \"^1.3.8\",\n \"mqtt\": \"^2.11.0\",\n \"source-map-support\": \"^0.4.15\"\n },\n \"devDependencies\": {\n \"@types/cuid\": \"^1.3.0\",\n \"@types/node\": \"^8.0.15\",\n \"serverless\": \"^1.19.0\",\n \"serverless-offline\": \"^3.15.3\",\n \"serverless-plugin-chrome\": \"^1.0.0-11\",\n \"serverless-plugin-typescript\": \"^1.0.0\"\n }\n}\n" }, { "path": "serverless/serverless.yml", "content": "service: chromeless-serverless\n\ncustom:\n stage: dev\n debug: \"*\"\n awsIotHost: ${env:AWS_IOT_HOST}\n chrome:\n functions:\n - run\n\nprovider:\n name: aws\n runtime: nodejs6.10\n stage: ${self:custom.stage}\n region: eu-west-1\n environment:\n DEBUG: ${self:custom.debug}\n AWS_IOT_HOST: ${self:custom.awsIotHost}\n apiKeys:\n - ${self:custom.stage}-chromeless-session-key\n iamRoleStatements:\n - Effect: \"Allow\"\n Action:\n - \"iot:Connect\"\n - \"iot:Publish\"\n - \"iot:Subscribe\"\n - \"iot:Receive\"\n - \"iot:GetThingShadow\"\n - \"iot:UpdateThingShadow\"\n Resource: \"*\"\n - Effect: \"Allow\"\n Action:\n - s3:*\n Resource:\n Fn::Join:\n - \"\"\n - - \"arn:aws:s3:::\"\n - Ref: AWS::AccountId\n - \"-\"\n - Ref: AWS::Region\n - -chromeless\n - /*\n\nplugins:\n - serverless-plugin-typescript\n - serverless-plugin-chrome\n - serverless-offline\n\nfunctions:\n run:\n memorySize: 1536\n timeout: 300\n handler: src/run.default\n events:\n - iot:\n sql: \"SELECT * FROM 'chrome/new-session'\"\n environment:\n CHROMELESS_S3_BUCKET_NAME:\n Fn::Join:\n - \"\"\n - - Ref: AWS::AccountId\n - \"-\"\n - Ref: AWS::Region\n - -chromeless\n CHROMELESS_S3_OBJECT_KEY_PREFIX: \"\"\n CHROMELESS_S3_OBJECT_ACL: \"public-read\"\n CHROMELESS_S3_BUCKET_URL:\n Fn::GetAtt:\n - Bucket\n - DomainName\n version:\n memorySize: 128\n handler: src/version.default\n events:\n - http:\n path: /version\n method: GET\n session:\n memorySize: 128\n timeout: 10\n handler: src/session.default\n events:\n - http:\n method: OPTIONS\n path: /\n private: true\n - http:\n method: GET\n path: /\n private: true\n disconnect:\n memorySize: 256\n handler: src/disconnect.default\n timeout: 10\n events:\n - iot:\n sql: \"SELECT * FROM 'chrome/last-will'\"\n\nresources:\n Resources:\n RunLogGroup:\n Properties:\n RetentionInDays: 7\n VersionLogGroup:\n Properties:\n RetentionInDays: 7\n SessionLogGroup:\n Properties:\n RetentionInDays: 7\n DisconnectLogGroup:\n Properties:\n RetentionInDays: 7\n Bucket:\n Type: AWS::S3::Bucket\n Properties:\n BucketName:\n Fn::Join:\n - \"\"\n - - Ref: AWS::AccountId\n - \"-\"\n - Ref: AWS::Region\n - -chromeless\n LifecycleConfiguration:\n Rules:\n - ExpirationInDays: 1\n Status: Enabled\n" }, { "path": "serverless/src/disconnect.ts", "content": "import * as AWS from 'aws-sdk'\nimport { debug } from './utils'\n\nconst iotData = new AWS.IotData({ endpoint: process.env.AWS_IOT_HOST })\n\nexport default async ({ channelId }, context, callback): Promise => {\n debug('Disconnect on', channelId)\n\n let params = {\n topic: `chrome/${channelId}/end`,\n payload: JSON.stringify({ channelId, client: true, disconnected: true }),\n qos: 1,\n }\n\n iotData.publish(params, callback)\n}\n" }, { "path": "serverless/src/run.ts", "content": "import 'source-map-support/register'\nimport { LocalChrome, Queue, ChromelessOptions } from 'chromeless'\nimport { connect as mqtt, MqttClient } from 'mqtt'\nimport { createPresignedURL, debug } from './utils'\n\nexport default async (\n { channelId, options },\n context,\n callback,\n chromeInstance\n): Promise => {\n // used to block requests from being processed while we're exiting\n let endingInvocation = false\n let timeout\n let executionCheckInterval\n\n debug('Invoked with data: ', channelId, options)\n\n const chrome = new LocalChrome({\n ...options,\n remote: false,\n launchChrome: false,\n cdp: { closeTab: true },\n })\n\n const queue = new Queue(chrome)\n\n const TOPIC_CONNECTED = `chrome/${channelId}/connected`\n const TOPIC_REQUEST = `chrome/${channelId}/request`\n const TOPIC_RESPONSE = `chrome/${channelId}/response`\n const TOPIC_END = `chrome/${channelId}/end`\n\n const channel = mqtt(createPresignedURL())\n\n if (process.env.DEBUG) {\n channel.on('error', error => debug('WebSocket error', error))\n channel.on('offline', () => debug('WebSocket offline'))\n }\n\n /*\n Clean up function whenever we want to end the invocation.\n Importantly we publish a message that we're disconnecting, and then\n we kill the running Chrome instance.\n */\n const end = (topic_end_data = {}) => {\n if (!endingInvocation) {\n endingInvocation = true\n clearInterval(executionCheckInterval)\n clearTimeout(timeout)\n\n channel.unsubscribe(TOPIC_END, () => {\n channel.publish(TOPIC_END, JSON.stringify({ channelId, chrome: true, ...topic_end_data }), {\n qos: 0,\n }, async () => {\n channel.end()\n\n await chrome.close()\n await chromeInstance.kill()\n\n callback()\n })\n })\n }\n }\n\n const newTimeout = () =>\n setTimeout(async () => {\n debug('Timing out. No requests received for 30 seconds.')\n await end({ inactivity: true })\n }, 30000)\n\n /*\n When we're almost out of time, we clean up.\n Importantly this makes sure that Chrome isn't running on the next invocation\n and publishes a message to the client letting it know we're disconnecting.\n */\n executionCheckInterval = setInterval(async () => {\n if (context.getRemainingTimeInMillis() < 5000) {\n debug('Ran out of execution time.')\n await end({ outOfTime: true })\n }\n }, 1000)\n\n channel.on('connect', () => {\n debug('Connected to AWS IoT broker')\n\n /*\n Publish that we've connected. This lets the client know that\n it can start sending requests (commands) for us to process.\n */\n channel.publish(TOPIC_CONNECTED, JSON.stringify({}), { qos: 1 })\n\n /*\n The main bit. Listen for requests from the client, handle them\n and respond with the result.\n */\n channel.subscribe(TOPIC_REQUEST, () => {\n debug(`Subscribed to ${TOPIC_REQUEST}`)\n\n timeout = newTimeout()\n\n channel.on('message', async (topic, buffer) => {\n if (TOPIC_REQUEST === topic && !endingInvocation) {\n const message = buffer.toString()\n\n clearTimeout(timeout)\n\n debug(`Message from ${TOPIC_REQUEST}`, message)\n\n const command = JSON.parse(message)\n\n try {\n const result = await queue.process(command)\n const remoteResult = JSON.stringify({\n value: result,\n })\n\n debug('Chrome result', result)\n\n channel.publish(TOPIC_RESPONSE, remoteResult, { qos: 1 })\n } catch (error) {\n const remoteResult = JSON.stringify({\n error: error.toString(),\n })\n\n debug('Chrome error', error)\n\n channel.publish(TOPIC_RESPONSE, remoteResult, { qos: 1 })\n }\n\n timeout = newTimeout()\n }\n })\n })\n\n /*\n Handle diconnection from the client.\n Either the client purposfully ended the session, or the client\n connection was abruptly ended resulting in a last-will message\n being dispatched by the IoT MQTT broker.\n */\n channel.subscribe(TOPIC_END, async () => {\n channel.on('message', async (topic, buffer) => {\n if (TOPIC_END === topic) {\n const message = buffer.toString()\n const data = JSON.parse(message)\n\n debug(`Message from ${TOPIC_END}`, message)\n debug(\n `Client ${data.disconnected ? 'disconnected' : 'ended session'}.`\n )\n\n await end()\n\n debug('Ended successfully.')\n }\n })\n })\n })\n}\n" }, { "path": "serverless/src/session.ts", "content": "import { connect as mqtt, MqttClient } from 'mqtt'\nimport * as cuid from 'cuid'\nimport { createPresignedURL, debug } from './utils'\n\nexport default async (event, context, callback): Promise => {\n const url = createPresignedURL()\n const channelId = cuid()\n\n callback(null, {\n statusCode: 200,\n body: JSON.stringify({ url, channelId }),\n })\n}\n" }, { "path": "serverless/src/utils.ts", "content": "import * as aws4 from 'aws4'\n\n/*\n This creates a presigned URL for accessing the AWS IoT MQTT Broker.\n Notably, the sessionToken is simply tacked on to the end, and not signed.\n Because AWS. Thank you @shortjared for your help pointing this out.\n*/\nexport function createPresignedURL(\n {\n host = process.env.AWS_IOT_HOST,\n path = '/mqtt',\n region = process.env.AWS_REGION,\n service = 'iotdevicegateway',\n accessKeyId = process.env.AWS_ACCESS_KEY_ID,\n secretAccessKey = process.env.AWS_SECRET_ACCESS_KEY,\n sessionToken = process.env.AWS_SESSION_TOKEN,\n // expires = 0, // @TODO: 300, check if this is working http://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-query-string-auth.html\n } = {},\n): string {\n const signed = aws4.sign(\n {\n host,\n path,\n service,\n region,\n signQuery: true,\n // headers: {\n // 'X-Amz-Expires': expires,\n // },\n },\n {\n accessKeyId,\n secretAccessKey,\n },\n )\n\n return `wss://${host}${signed.path}&X-Amz-Security-Token=${encodeURIComponent(\n sessionToken,\n )}`\n}\n\nexport function debug(...log) {\n if (process.env.DEBUG) {\n console.log(\n ...log.map(\n argument =>\n typeof argument === 'object'\n ? JSON.stringify(argument, null, 2)\n : argument\n )\n )\n }\n}\n" }, { "path": "serverless/src/version.ts", "content": "import { version as chromelessVersion } from 'chromeless'\n\nconst serverlessChromelessVersion = require('../package.json').version\n\nexport default async (event, context, callback): Promise => {\n callback(null, {\n statusCode: 200,\n body: JSON.stringify({\n chromeless: chromelessVersion,\n serverlessChromeless: serverlessChromelessVersion,\n }),\n })\n}\n" }, { "path": "serverless/tsconfig.json", "content": "{\n \"compilerOptions\": {\n \"module\": \"commonjs\",\n \"rootDir\": \".\",\n \"target\": \"es6\",\n \"sourceMap\": true,\n \"moduleResolution\": \"node\"\n },\n \"exclude\": [\n \"node_modules\"\n ]\n}\n" }, { "path": "src/__tests__/test.html", "content": "\n\n\n \n Title\n\n\n
\n
\"Chromeless\"
\n
\n

This is a test page for Chromeless unit tests

\n
\n
\n\n" }, { "path": "src/api.ts", "content": "import ChromeLocal from './chrome/local'\nimport ChromeRemote from './chrome/remote'\nimport Queue from './queue'\nimport {\n ChromelessOptions,\n Headers,\n Cookie,\n CookieQuery,\n PdfOptions,\n DeviceMetrics,\n ScreenshotOptions,\n} from './types'\nimport { getDebugOption } from './util'\nimport { isArray } from 'util'\n\nexport default class Chromeless implements Promise {\n private queue: Queue\n private lastReturnPromise: Promise\n\n constructor(options: ChromelessOptions = {}, copyInstance?: Chromeless) {\n if (copyInstance) {\n this.queue = copyInstance.queue\n this.lastReturnPromise = copyInstance.lastReturnPromise\n return\n }\n\n const mergedOptions: ChromelessOptions = {\n debug: getDebugOption(),\n waitTimeout: 10000,\n remote: false,\n implicitWait: true,\n scrollBeforeClick: false,\n launchChrome: true,\n\n ...options,\n\n viewport: {\n scale: 1,\n ...options.viewport,\n },\n\n cdp: {\n host: process.env['CHROMELESS_CHROME_HOST'] || 'localhost',\n port: parseInt(process.env['CHROMELESS_CHROME_PORT'], 10) || 9222,\n secure: false,\n closeTab: true,\n ...options.cdp,\n },\n }\n\n const chrome = mergedOptions.remote\n ? new ChromeRemote(mergedOptions)\n : new ChromeLocal(mergedOptions)\n\n this.queue = new Queue(chrome)\n\n this.lastReturnPromise = Promise.resolve(undefined)\n }\n\n /*\n * The following 3 members are needed to implement a Promise\n */\n readonly [Symbol.toStringTag]: 'Promise'\n\n then(\n onFulfill?: ((value: T) => U | PromiseLike) | null,\n onReject?: ((error: any) => U | PromiseLike) | null,\n ): Promise {\n return this.lastReturnPromise.then(onFulfill, onReject) as Promise\n }\n\n catch(onrejected?: (reason: any) => U | PromiseLike): Promise {\n return this.lastReturnPromise.catch(onrejected) as Promise\n }\n\n goto(url: string, timeout?: number): Chromeless {\n this.queue.enqueue({ type: 'goto', url, timeout })\n\n return this\n }\n\n setUserAgent(useragent: string): Chromeless {\n this.queue.enqueue({ type: 'setUserAgent', useragent })\n\n return this\n }\n\n click(selector: string, x?: number, y?: number): Chromeless {\n this.queue.enqueue({ type: 'click', selector, x, y })\n\n return this\n }\n\n wait(timeout: number): Chromeless\n wait(selector: string, timeout?: number): Chromeless\n wait(fn: (...args: any[]) => boolean, ...args: any[]): Chromeless\n wait(firstArg, ...args: any[]): Chromeless {\n switch (typeof firstArg) {\n case 'number': {\n this.queue.enqueue({ type: 'wait', timeout: firstArg })\n break\n }\n case 'string': {\n this.queue.enqueue({\n type: 'wait',\n selector: firstArg,\n timeout: args[0],\n })\n break\n }\n case 'function': {\n this.queue.enqueue({ type: 'wait', fn: firstArg, args })\n break\n }\n default:\n throw new Error(`Invalid wait arguments: ${firstArg} ${args}`)\n }\n\n return this\n }\n\n clearCache(): Chromeless {\n this.queue.enqueue({ type: 'clearCache' })\n\n return this\n }\n\n clearStorage(origin: string, storageTypes: string): Chromeless {\n this.queue.enqueue({ type: 'clearStorage', origin, storageTypes })\n\n return this\n }\n\n focus(selector: string): Chromeless {\n this.queue.enqueue({ type: 'focus', selector })\n return this\n }\n\n press(keyCode: number, count?: number, modifiers?: any): Chromeless {\n this.queue.enqueue({ type: 'press', keyCode, count, modifiers })\n\n return this\n }\n\n type(input: string, selector?: string): Chromeless {\n this.queue.enqueue({ type: 'type', input, selector })\n\n return this\n }\n\n back(): Chromeless {\n throw new Error('Not implemented yet')\n }\n\n forward(): Chromeless {\n throw new Error('Not implemented yet')\n }\n\n refresh(): Chromeless {\n throw new Error('Not implemented yet')\n }\n\n mousedown(selector: string): Chromeless {\n this.queue.enqueue({ type: 'mousedown', selector })\n return this\n }\n\n mouseup(selector: string): Chromeless {\n this.queue.enqueue({ type: 'mouseup', selector })\n return this\n }\n\n mouseover(): Chromeless {\n throw new Error('Not implemented yet')\n }\n\n scrollTo(x: number, y: number): Chromeless {\n this.queue.enqueue({ type: 'scrollTo', x, y })\n\n return this\n }\n\n scrollToElement(selector: string): Chromeless {\n this.queue.enqueue({ type: 'scrollToElement', selector })\n\n return this\n }\n\n setViewport(options: DeviceMetrics): Chromeless {\n this.queue.enqueue({ type: 'setViewport', options })\n\n return this\n }\n\n setHtml(html: string): Chromeless {\n this.queue.enqueue({ type: 'setHtml', html })\n\n return this\n }\n\n setExtraHTTPHeaders(headers: Headers): Chromeless {\n this.queue.enqueue({ type: 'setExtraHTTPHeaders', headers })\n\n return this\n }\n\n evaluate(\n fn: (...args: any[]) => U,\n ...args: any[]\n ): Chromeless {\n this.lastReturnPromise = this.queue.process({\n type: 'returnCode',\n fn: fn.toString(),\n args,\n })\n\n return new Chromeless({}, this)\n }\n\n inputValue(selector: string): Chromeless {\n this.lastReturnPromise = this.queue.process({\n type: 'returnInputValue',\n selector,\n })\n\n return new Chromeless({}, this)\n }\n\n exists(selector: string): Chromeless {\n this.lastReturnPromise = this.queue.process({\n type: 'returnExists',\n selector,\n })\n\n return new Chromeless({}, this)\n }\n\n screenshot(\n selector?: string,\n options?: ScreenshotOptions,\n ): Chromeless {\n if (typeof selector === 'object') {\n options = selector\n selector = undefined\n }\n this.lastReturnPromise = this.queue.process({\n type: 'returnScreenshot',\n selector,\n options,\n })\n\n return new Chromeless({}, this)\n }\n\n html(): Chromeless {\n this.lastReturnPromise = this.queue.process({ type: 'returnHtml' })\n\n return new Chromeless({}, this)\n }\n\n htmlUrl(): Chromeless {\n this.lastReturnPromise = this.queue.process({\n type: 'returnHtmlUrl',\n })\n\n return new Chromeless({}, this)\n }\n\n pdf(options?: PdfOptions): Chromeless {\n this.lastReturnPromise = this.queue.process({\n type: 'returnPdf',\n options,\n })\n\n return new Chromeless({}, this)\n }\n\n /**\n * Get the cookies for the current url\n */\n cookies(): Chromeless\n /**\n * Get a specific cookie for the current url\n * @param name\n */\n cookies(name: string): Chromeless\n /**\n * Get a specific cookie by query. Not implemented yet\n * @param query\n */\n cookies(query: CookieQuery): Chromeless\n cookies(\n nameOrQuery?: string | CookieQuery,\n ): Chromeless {\n if (typeof nameOrQuery !== 'undefined' && typeof nameOrQuery !== 'string') {\n throw new Error('Querying cookies is not implemented yet')\n }\n\n this.lastReturnPromise = this.queue.process({\n type: 'cookies',\n nameOrQuery,\n })\n\n return new Chromeless({}, this)\n }\n\n allCookies(): Chromeless {\n this.lastReturnPromise = this.queue.process({\n type: 'allCookies',\n })\n\n return new Chromeless({}, this)\n }\n\n setCookies(name: string, value: string): Chromeless\n setCookies(cookie: Cookie): Chromeless\n setCookies(cookies: Cookie[]): Chromeless\n setCookies(nameOrCookies, value?: string): Chromeless {\n this.queue.enqueue({ type: 'setCookies', nameOrCookies, value })\n\n return this\n }\n\n deleteCookies(name: string, url: string): Chromeless {\n if (typeof name === 'undefined') {\n throw new Error('Cookie name should be defined.')\n }\n if (typeof url === 'undefined') {\n throw new Error('Cookie url should be defined.')\n }\n this.queue.enqueue({ type: 'deleteCookies', name, url })\n\n return this\n }\n\n clearCookies(): Chromeless {\n this.queue.enqueue({ type: 'clearCookies' })\n\n return this\n }\n\n clearInput(selector: string): Chromeless {\n this.queue.enqueue({ type: 'clearInput', selector })\n return this\n }\n\n setFileInput(selector: string, files: string): Chromeless\n setFileInput(selector: string, files: string[]): Chromeless\n setFileInput(selector: string, files: string | string[]): Chromeless {\n if (!isArray(files)) {\n files = [files]\n }\n this.queue.enqueue({ type: 'setFileInput', selector, files })\n return this\n }\n\n async end(): Promise {\n const result = await this.lastReturnPromise\n await this.queue.end()\n return result\n }\n}\n" }, { "path": "src/chrome/local-runtime.ts", "content": "import {\n Client,\n Command,\n ChromelessOptions,\n Headers,\n Cookie,\n CookieQuery,\n PdfOptions,\n ScreenshotOptions,\n} from '../types'\nimport {\n nodeExists,\n wait,\n waitForNode,\n click,\n evaluate,\n screenshot,\n html,\n htmlUrl,\n pdf,\n type,\n getValue,\n scrollTo,\n scrollToElement,\n setHtml,\n setExtraHTTPHeaders,\n press,\n setViewport,\n clearCookies,\n deleteCookie,\n getCookies,\n setCookies,\n getAllCookies,\n version,\n mousedown,\n mouseup,\n focus,\n clearInput,\n setFileInput,\n writeToFile,\n isS3Configured,\n uploadToS3,\n eventToPromise,\n waitForPromise,\n} from '../util'\n\nexport default class LocalRuntime {\n private client: Client\n private chromelessOptions: ChromelessOptions\n private userAgentValue: string\n\n constructor(client: Client, chromelessOptions: ChromelessOptions) {\n this.client = client\n this.chromelessOptions = chromelessOptions\n }\n\n async run(command: Command): Promise {\n switch (command.type) {\n case 'goto':\n return this.goto(command.url, command.timeout)\n case 'setViewport':\n return setViewport(this.client, command.options)\n case 'wait': {\n if (command.selector) {\n return this.waitSelector(command.selector, command.timeout)\n } else if (command.timeout) {\n return this.waitTimeout(command.timeout)\n } else {\n throw new Error('waitFn not yet implemented')\n }\n }\n case 'clearCache':\n return this.clearCache()\n case 'clearStorage':\n return this.clearStorage(command.origin, command.storageTypes)\n case 'setUserAgent':\n return this.setUserAgent(command.useragent)\n case 'click':\n return this.click(command.selector, command.x, command.y)\n case 'returnCode':\n return this.returnCode(command.fn, ...command.args)\n case 'returnExists':\n return this.returnExists(command.selector)\n case 'returnScreenshot':\n return this.returnScreenshot(command.selector, command.options)\n case 'returnHtml':\n return this.returnHtml()\n case 'returnHtmlUrl':\n return this.returnHtmlUrl()\n case 'returnPdf':\n return this.returnPdf(command.options)\n case 'returnInputValue':\n return this.returnInputValue(command.selector)\n case 'type':\n return this.type(command.input, command.selector)\n case 'press':\n return this.press(command.keyCode, command.count, command.modifiers)\n case 'scrollTo':\n return this.scrollTo(command.x, command.y)\n case 'scrollToElement':\n return this.scrollToElement(command.selector)\n case 'deleteCookies':\n return this.deleteCookies(command.name, command.url)\n case 'clearCookies':\n return this.clearCookies()\n case 'setHtml':\n return this.setHtml(command.html)\n case 'setExtraHTTPHeaders':\n return this.setExtraHTTPHeaders(command.headers)\n case 'cookies':\n return this.cookies(command.nameOrQuery)\n case 'allCookies':\n return this.allCookies()\n case 'setCookies':\n return this.setCookies(command.nameOrCookies, command.value)\n case 'mousedown':\n return this.mousedown(command.selector)\n case 'mouseup':\n return this.mouseup(command.selector)\n case 'focus':\n return this.focus(command.selector)\n case 'clearInput':\n return this.clearInput(command.selector)\n case 'setFileInput':\n return this.setFileInput(command.selector, command.files)\n default:\n throw new Error(`No such command: ${JSON.stringify(command)}`)\n }\n }\n\n private async goto(\n url: string,\n waitTimeout: number = this.chromelessOptions.waitTimeout,\n ): Promise {\n const { Network, Page } = this.client\n await Promise.all([Network.enable(), Page.enable()])\n if (!this.userAgentValue) this.userAgentValue = `Chromeless ${version}`\n await Network.setUserAgentOverride({ userAgent: this.userAgentValue })\n const e2p = eventToPromise()\n Page.loadEventFired(e2p.onEvent)\n await Page.navigate({ url })\n await waitForPromise(e2p.fired(), waitTimeout, 'page load event')\n this.log(`Navigated to ${url}`)\n }\n\n private async clearCache(): Promise {\n const { Network } = this.client\n const canClearCache = await Network.canClearBrowserCache\n if (canClearCache) {\n await Network.clearBrowserCache()\n this.log(`Cache is cleared`)\n } else {\n this.log(`Cache could not be cleared`)\n }\n }\n\n private async clearStorage(\n origin: string,\n storageTypes: string,\n ): Promise {\n const { Storage, Network } = this.client\n const canClearCache = await Network.canClearBrowserCache\n if (canClearCache) {\n await Storage.clearDataForOrigin({ origin, storageTypes })\n this.log(`${storageTypes} for ${origin} is cleared`)\n } else {\n this.log(`${storageTypes} could not be cleared`)\n }\n }\n\n private async setUserAgent(useragent: string): Promise {\n this.userAgentValue = useragent\n await this.log(`Set useragent to ${this.userAgentValue}`)\n }\n\n private async waitTimeout(timeout: number): Promise {\n this.log(`Waiting for ${timeout}ms`)\n await wait(timeout)\n }\n\n private async waitSelector(\n selector: string,\n waitTimeout: number = this.chromelessOptions.waitTimeout,\n ): Promise {\n this.log(`Waiting for ${selector} ${waitTimeout}`)\n await waitForNode(this.client, selector, waitTimeout)\n this.log(`Waited for ${selector}`)\n }\n\n private async click(selector: string, x?: number, y?: number): Promise {\n if (this.chromelessOptions.implicitWait) {\n this.log(`click(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(`click(): node for selector ${selector} doesn't exist`)\n }\n\n const { scale } = this.chromelessOptions.viewport\n if (this.chromelessOptions.scrollBeforeClick) {\n await scrollToElement(this.client, selector)\n }\n await click(this.client, selector, scale, x, y)\n this.log(`Clicked on ${selector} at (${x}, ${y})`)\n }\n\n private async returnCode(fn: string, ...args: any[]): Promise {\n return (await evaluate(this.client, fn, ...args)) as T\n }\n\n private async scrollTo(x: number, y: number): Promise {\n return scrollTo(this.client, x, y)\n }\n\n private async scrollToElement(selector: string): Promise {\n if (this.chromelessOptions.implicitWait) {\n this.log(`scrollToElement(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n return scrollToElement(this.client, selector)\n }\n\n private async mousedown(selector: string): Promise {\n if (this.chromelessOptions.implicitWait) {\n this.log(`mousedown(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(\n `mousedown(): node for selector ${selector} doesn't exist`,\n )\n }\n\n const { scale } = this.chromelessOptions.viewport\n await mousedown(this.client, selector, scale)\n this.log(`Mousedown on ${selector}`)\n }\n\n private async mouseup(selector: string): Promise {\n if (this.chromelessOptions.implicitWait) {\n this.log(`mouseup(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(`mouseup(): node for selector ${selector} doesn't exist`)\n }\n\n const { scale } = this.chromelessOptions.viewport\n await mouseup(this.client, selector, scale)\n this.log(`Mouseup on ${selector}`)\n }\n\n private async setHtml(html: string): Promise {\n await setHtml(this.client, html)\n }\n\n private async focus(selector: string): Promise {\n if (this.chromelessOptions.implicitWait) {\n this.log(`focus(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(`focus(): node for selector ${selector} doesn't exist`)\n }\n\n await focus(this.client, selector)\n this.log(`Focus on ${selector}`)\n }\n\n async type(text: string, selector?: string): Promise {\n if (selector) {\n if (this.chromelessOptions.implicitWait) {\n this.log(`type(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(`type(): Node not found for selector: ${selector}`)\n }\n }\n await type(this.client, text, selector)\n this.log(`Typed ${text} in ${selector}`)\n }\n\n async cookies(nameOrQuery?: string | CookieQuery): Promise {\n return await getCookies(this.client, nameOrQuery as string | undefined)\n }\n\n async allCookies(): Promise {\n return await getAllCookies(this.client)\n }\n\n async setExtraHTTPHeaders(headers: Headers): Promise {\n return await setExtraHTTPHeaders(this.client, headers)\n }\n\n async setCookies(\n nameOrCookies: string | Cookie | Cookie[],\n value?: string,\n ): Promise {\n if (typeof nameOrCookies !== 'string' && !value) {\n const cookies = Array.isArray(nameOrCookies)\n ? nameOrCookies\n : [nameOrCookies]\n return await setCookies(this.client, cookies)\n }\n\n if (typeof nameOrCookies === 'string' && typeof value === 'string') {\n const fn = () => location.href\n const url = (await evaluate(this.client, `${fn}`)) as string\n const cookie: Cookie = {\n url,\n name: nameOrCookies,\n value,\n }\n return await setCookies(this.client, [cookie])\n }\n\n throw new Error(`setCookies(): Invalid input ${nameOrCookies}, ${value}`)\n }\n\n async deleteCookies(name: string, url: string): Promise {\n const { Network } = this.client\n const canClearCookies = await Network.canClearBrowserCookies()\n if (canClearCookies) {\n await deleteCookie(this.client, name, url)\n this.log(`Cookie ${name} cleared`)\n } else {\n this.log(`Cookie ${name} could not be cleared`)\n }\n }\n\n async clearCookies(): Promise {\n const { Network } = this.client\n const canClearCookies = await Network.canClearBrowserCookies()\n if (canClearCookies) {\n await clearCookies(this.client)\n this.log('Cookies cleared')\n } else {\n this.log('Cookies could not be cleared')\n }\n }\n\n async press(keyCode: number, count?: number, modifiers?: any): Promise {\n this.log(`Sending keyCode ${keyCode} (modifiers: ${modifiers})`)\n await press(this.client, keyCode, count, modifiers)\n }\n\n async returnExists(selector: string): Promise {\n return await nodeExists(this.client, selector)\n }\n\n async returnInputValue(selector: string): Promise {\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(`value: node for selector ${selector} doesn't exist`)\n }\n return getValue(this.client, selector)\n }\n\n // Returns the S3 url or local file path\n async returnScreenshot(\n selector?: string,\n options?: ScreenshotOptions,\n ): Promise {\n if (selector) {\n if (this.chromelessOptions.implicitWait) {\n this.log(`screenshot(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(\n `screenshot(): node for selector ${selector} doesn't exist`,\n )\n }\n }\n\n const data = await screenshot(this.client, selector, options)\n\n if (isS3Configured()) {\n return await uploadToS3(data, 'image/png')\n } else {\n return writeToFile(data, 'png', options && options.filePath)\n }\n }\n\n async returnHtml(): Promise {\n return await html(this.client)\n }\n\n async returnHtmlUrl(options?: { filePath?: string }): Promise {\n const data = await html(this.client)\n\n if (isS3Configured()) {\n return await uploadToS3(data, 'text/html')\n } else {\n return writeToFile(data, 'html', options && options.filePath)\n }\n }\n\n // Returns the S3 url or local file path\n async returnPdf(options?: PdfOptions): Promise {\n const { filePath, ...cdpOptions } = options || { filePath: undefined }\n const data = await pdf(this.client, cdpOptions)\n\n if (isS3Configured()) {\n return await uploadToS3(data, 'application/pdf')\n } else {\n return writeToFile(data, 'pdf', filePath)\n }\n }\n\n async clearInput(selector: string): Promise {\n if (selector) {\n if (this.chromelessOptions.implicitWait) {\n this.log(`clearInput(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(\n `clearInput(): Node not found for selector: ${selector}`,\n )\n }\n }\n await clearInput(this.client, selector)\n this.log(`${selector} cleared`)\n }\n\n async setFileInput(selector: string, files: string[]): Promise {\n if (this.chromelessOptions.implicitWait) {\n this.log(`setFileInput(): Waiting for ${selector}`)\n await waitForNode(\n this.client,\n selector,\n this.chromelessOptions.waitTimeout,\n )\n }\n\n const exists = await nodeExists(this.client, selector)\n if (!exists) {\n throw new Error(\n `setFileInput(): node for selector ${selector} doesn't exist`,\n )\n }\n\n await setFileInput(this.client, selector, files)\n this.log(`setFileInput() files ${files}`)\n }\n\n private log(msg: string): void {\n if (this.chromelessOptions.debug) {\n console.log(msg)\n }\n }\n}\n" }, { "path": "src/chrome/local.ts", "content": "import { Chrome, Command, ChromelessOptions, Client } from '../types'\nimport * as CDP from 'chrome-remote-interface'\nimport { LaunchedChrome, launch } from 'chrome-launcher'\nimport LocalRuntime from './local-runtime'\nimport { evaluate, setViewport } from '../util'\nimport { DeviceMetrics } from '../types'\n\ninterface RuntimeClient {\n client: Client\n runtime: LocalRuntime\n}\n\nexport default class LocalChrome implements Chrome {\n private options: ChromelessOptions\n private runtimeClientPromise: Promise\n private chromeInstance?: LaunchedChrome\n\n constructor(options: ChromelessOptions = {}) {\n this.options = options\n\n this.runtimeClientPromise = this.initRuntimeClient()\n }\n\n private async initRuntimeClient(): Promise {\n const client = this.options.launchChrome\n ? await this.startChrome()\n : await this.connectToChrome()\n\n const { viewport = {} as DeviceMetrics } = this.options\n await setViewport(client, viewport as DeviceMetrics)\n\n const runtime = new LocalRuntime(client, this.options)\n\n return { client, runtime }\n }\n\n private async startChrome(): Promise {\n const { port } = this.options.cdp\n this.chromeInstance = await launch({\n logLevel: this.options.debug ? 'info' : 'silent',\n chromeFlags: [\n // Do not render scroll bars\n '--hide-scrollbars',\n\n // The following options copied verbatim from https://github.com/GoogleChrome/chrome-launcher/blob/master/src/flags.ts\n\n // Disable built-in Google Translate service\n '--disable-translate',\n // Disable all chrome extensions entirely\n '--disable-extensions',\n // Disable various background network services, including extension updating,\n // safe browsing service, upgrade detector, translate, UMA\n '--disable-background-networking',\n // Disable fetching safebrowsing lists, likely redundant due to disable-background-networking\n '--safebrowsing-disable-auto-update',\n // Disable syncing to a Google account\n '--disable-sync',\n // Disable reporting to UMA, but allows for collection\n '--metrics-recording-only',\n // Mute any audio\n '--mute-audio',\n // Skip first run wizards\n '--no-first-run',\n ],\n port,\n })\n const target = await CDP.New({\n port,\n })\n return await CDP({ target, port })\n }\n\n private async connectToChrome(): Promise {\n const { host, port } = this.options.cdp\n const target = await CDP.New({\n port,\n host,\n })\n return await CDP({ target, host, port })\n }\n\n private async setViewport(client: Client) {\n const { viewport = {} } = this.options\n\n const config: any = {\n deviceScaleFactor: 1,\n mobile: false,\n scale: viewport.scale || 1,\n fitWindow: false, // as we cannot resize the window, `fitWindow: false` is needed in order for the viewport to be resizable\n }\n\n const { host, port } = this.options.cdp\n const versionResult = await CDP.Version({ host, port })\n const isHeadless = versionResult['User-Agent'].includes('Headless')\n\n if (viewport.height && viewport.width) {\n config.height = viewport.height\n config.width = viewport.width\n } else if (isHeadless) {\n // just apply default value in headless mode to maintain original browser viewport\n config.height = 900\n config.width = 1440\n } else {\n config.height = await evaluate(\n client,\n (() => window.innerHeight).toString(),\n )\n config.width = await evaluate(\n client,\n (() => window.innerWidth).toString(),\n )\n }\n\n await client.Emulation.setDeviceMetricsOverride(config)\n await client.Emulation.setVisibleSize({\n width: config.width,\n height: config.height,\n })\n }\n\n async process(command: Command): Promise {\n const { runtime } = await this.runtimeClientPromise\n\n return (await runtime.run(command)) as T\n }\n\n async close(): Promise {\n const { client } = await this.runtimeClientPromise\n\n if (this.options.cdp.closeTab) {\n const { host, port } = this.options.cdp\n await CDP.Close({ host, port, id: client.target.id })\n }\n\n if (this.chromeInstance) {\n this.chromeInstance.kill()\n }\n\n await client.close()\n }\n}\n" }, { "path": "src/chrome/remote.ts", "content": "import { Chrome, ChromelessOptions, Command, RemoteOptions } from '../types'\nimport { connect as mqtt, MqttClient } from 'mqtt'\nimport * as cuid from 'cuid'\nimport * as got from 'got'\n\ninterface RemoteResult {\n value?: any\n error?: string\n}\n\nfunction getEndpoint(remoteOptions: RemoteOptions | boolean): RemoteOptions {\n if (typeof remoteOptions === 'object' && remoteOptions.endpointUrl) {\n return remoteOptions\n }\n\n if (\n process.env['CHROMELESS_ENDPOINT_URL'] &&\n process.env['CHROMELESS_ENDPOINT_API_KEY']\n ) {\n return {\n endpointUrl: process.env['CHROMELESS_ENDPOINT_URL'],\n apiKey: process.env['CHROMELESS_ENDPOINT_API_KEY'],\n }\n }\n\n throw new Error(\n 'No Chromeless remote endpoint & API key provided. Either set as \"remote\" option in constructor or set as \"CHROMELESS_ENDPOINT_URL\" and \"CHROMELESS_ENDPOINT_API_KEY\" env variables.',\n )\n}\n\nexport default class RemoteChrome implements Chrome {\n private options: ChromelessOptions\n private channelId: string\n private channel: MqttClient\n private connectionPromise: Promise\n private TOPIC_NEW_SESSION: string\n private TOPIC_CONNECTED: string\n private TOPIC_REQUEST: string\n private TOPIC_RESPONSE: string\n private TOPIC_END: string\n\n constructor(options: ChromelessOptions) {\n this.options = options\n this.connectionPromise = this.initConnection()\n }\n\n private async initConnection(): Promise {\n await new Promise(async (resolve, reject) => {\n const timeout = setTimeout(() => {\n if (this.channel) {\n this.channel.end()\n }\n\n reject(\n new Error(\n \"Timed out after 30sec. Connection couldn't be established.\",\n ),\n )\n }, 30000)\n\n try {\n const { endpointUrl, apiKey } = getEndpoint(this.options.remote)\n const { body: { url, channelId } } = await got(endpointUrl, {\n headers: apiKey\n ? {\n 'x-api-key': apiKey,\n }\n : undefined,\n json: true,\n })\n\n this.channelId = channelId\n\n this.TOPIC_NEW_SESSION = 'chrome/new-session'\n this.TOPIC_CONNECTED = `chrome/${channelId}/connected`\n this.TOPIC_REQUEST = `chrome/${channelId}/request`\n this.TOPIC_RESPONSE = `chrome/${channelId}/response`\n this.TOPIC_END = `chrome/${channelId}/end`\n\n const channel = mqtt(url, {\n will: {\n topic: 'chrome/last-will',\n payload: JSON.stringify({ channelId }),\n qos: 1,\n retain: false,\n },\n })\n\n this.channel = channel\n\n if (this.options.debug) {\n channel.on('error', error => console.log('WebSocket error', error))\n channel.on('offline', () => console.log('WebSocket offline'))\n }\n\n channel.on('connect', () => {\n if (this.options.debug) {\n console.log('Connected to message broker.')\n }\n\n channel.subscribe(this.TOPIC_CONNECTED, { qos: 1 }, () => {\n channel.on('message', async topic => {\n if (this.TOPIC_CONNECTED === topic) {\n clearTimeout(timeout)\n resolve()\n }\n })\n\n channel.publish(\n this.TOPIC_NEW_SESSION,\n JSON.stringify({ channelId, options: this.options }),\n { qos: 1 },\n )\n })\n\n channel.subscribe(this.TOPIC_END, () => {\n channel.on('message', async (topic, buffer) => {\n if (this.TOPIC_END === topic) {\n const message = buffer.toString()\n const data = JSON.parse(message)\n\n if (data.outOfTime) {\n console.warn(\n `Chromeless Proxy disconnected because it reached it's execution time limit (5 minutes).`,\n )\n } else if (data.inactivity) {\n console.warn(\n 'Chromeless Proxy disconnected due to inactivity (no commands sent for 30 seconds).',\n )\n } else {\n console.warn(\n `Chromeless Proxy disconnected (we don't know why).`,\n data,\n )\n }\n\n await this.close()\n }\n })\n })\n })\n } catch (error) {\n console.error(error)\n\n reject(\n new Error('Unable to get presigned websocket URL and connect to it.'),\n )\n }\n })\n }\n\n async process(command: Command): Promise {\n // wait until lambda connection is established\n await this.connectionPromise\n\n if (this.options.debug) {\n console.log(`Running remotely: ${JSON.stringify(command)}`)\n }\n\n const promise = new Promise((resolve, reject) => {\n this.channel.subscribe(this.TOPIC_RESPONSE, () => {\n this.channel.on('message', (topic, buffer) => {\n if (this.TOPIC_RESPONSE === topic) {\n const message = buffer.toString()\n const result = JSON.parse(message) as RemoteResult\n\n if (result.error) {\n reject(result.error)\n } else if (result.value) {\n resolve(result.value)\n } else {\n resolve()\n }\n }\n })\n this.channel.publish(this.TOPIC_REQUEST, JSON.stringify(command))\n })\n })\n\n return promise\n }\n\n async close(): Promise {\n this.channel.publish(\n this.TOPIC_END,\n JSON.stringify({ channelId: this.channelId, client: true }),\n )\n\n this.channel.end()\n }\n}\n" }, { "path": "src/index.ts", "content": "import Chromeless from './api'\nimport Queue from './queue'\nimport LocalChrome from './chrome/local'\nimport { version } from './util'\nimport { Cookie, ChromelessOptions } from './types'\n\nexport { Queue, LocalChrome, Chromeless, Cookie, ChromelessOptions, version }\n\nexport default Chromeless\n" }, { "path": "src/queue.ts", "content": "import { Chrome, Command } from './types'\n\nexport default class Queue {\n private flushCount: number\n private commandQueue: {\n [flushCount: number]: Command[]\n }\n private chrome: Chrome\n private lastWaitAll: Promise\n\n constructor(chrome: Chrome) {\n this.chrome = chrome\n this.flushCount = 0\n this.commandQueue = {\n 0: [],\n }\n }\n\n async end(): Promise {\n this.lastWaitAll = this.waitAll()\n await this.lastWaitAll\n\n await this.chrome.close()\n }\n\n enqueue(command: Command): void {\n this.commandQueue[this.flushCount].push(command)\n }\n\n async process(command: Command): Promise {\n // with lastWaitAll we build a promise chain\n // already change the pointer to lastWaitAll for the next .process() call\n // after the pointer is set, wait for the previous tasks\n // then wait for the own pointer (the new .lastWaitAll)\n if (this.lastWaitAll) {\n const lastWaitAllTmp = this.lastWaitAll\n this.lastWaitAll = this.waitAll()\n await lastWaitAllTmp\n } else {\n this.lastWaitAll = this.waitAll()\n }\n\n await this.lastWaitAll\n\n return this.chrome.process(command)\n }\n\n private async waitAll(): Promise {\n const previousFlushCount = this.flushCount\n\n this.flushCount++\n this.commandQueue[this.flushCount] = []\n\n for (const command of this.commandQueue[previousFlushCount]) {\n await this.chrome.process(command)\n }\n }\n}\n" }, { "path": "src/types.ts", "content": "export interface Client {\n Network: any\n Page: any\n DOM: any\n Input: any\n Runtime: any\n Emulation: any\n Storage: any\n close: () => void\n target: {\n id: string\n }\n port: any\n host: any\n}\n\nexport interface DeviceMetrics {\n width: number\n height: number\n deviceScaleFactor?: number\n mobile?: boolean\n scale?: number\n screenOrientation?: ScreenOrientation\n}\n\nexport interface ScreenOrientation {\n type: string\n angle: number\n}\n\nexport interface RemoteOptions {\n endpointUrl: string\n apiKey?: string\n}\n\nexport interface CDPOptions {\n host?: string // localhost\n port?: number // 9222\n secure?: boolean // false\n closeTab?: boolean // true\n}\n\nexport interface ChromelessOptions {\n debug?: boolean // false\n waitTimeout?: number // 10000ms\n implicitWait?: boolean // false\n scrollBeforeClick?: boolean // false\n viewport?: {\n width?: number // 1440 if headless\n height?: number // 900 if headless\n scale?: number // 1\n }\n launchChrome?: boolean // auto-launch chrome (local) `true`\n cdp?: CDPOptions\n remote?: RemoteOptions | boolean\n}\n\nexport interface Chrome {\n process(command: Command): Promise\n close(): Promise\n}\n\nexport type Command =\n | {\n type: 'goto'\n url: string\n timeout?: number\n }\n | {\n type: 'clearCache'\n }\n | {\n type: 'setViewport'\n options: DeviceMetrics\n }\n | {\n type: 'setUserAgent'\n useragent: string\n }\n | {\n type: 'wait'\n timeout?: number\n selector?: string\n fn?: string\n args?: any[]\n }\n | {\n type: 'click'\n selector: string\n x?: number\n y?: number\n }\n | {\n type: 'returnCode'\n fn: string\n args?: any[]\n }\n | {\n type: 'returnInputValue'\n selector: string\n }\n | {\n type: 'returnExists'\n selector: string\n }\n | {\n type: 'returnValue'\n selector: string\n }\n | {\n type: 'returnScreenshot'\n selector?: string\n options?: ScreenshotOptions\n }\n | {\n type: 'returnHtml'\n }\n | {\n type: 'returnHtmlUrl'\n }\n | {\n type: 'returnPdf'\n options?: PdfOptions\n }\n | {\n type: 'scrollTo'\n x: number\n y: number\n }\n | {\n type: 'scrollToElement'\n selector: string\n }\n | {\n type: 'setHtml'\n html: string\n }\n | {\n type: 'setExtraHTTPHeaders'\n headers: Headers\n }\n | {\n type: 'press'\n keyCode: number\n count?: number\n modifiers?: any\n }\n | {\n type: 'type'\n input: string\n selector?: string\n }\n | {\n type: 'clearCookies'\n }\n | {\n type: 'clearStorage'\n origin: string\n storageTypes: string\n }\n | {\n type: 'deleteCookies'\n name: string\n url: string\n }\n | {\n type: 'setCookies'\n nameOrCookies: string | Cookie | Cookie[]\n value?: string\n }\n | {\n type: 'allCookies'\n }\n | {\n type: 'cookies'\n nameOrQuery?: string | CookieQuery\n }\n | {\n type: 'mousedown'\n selector: string\n }\n | {\n type: 'mouseup'\n selector: string\n }\n | {\n type: 'focus'\n selector: string\n }\n | {\n type: 'clearInput'\n selector: string\n }\n | {\n type: 'setFileInput'\n selector: string\n files: string[]\n }\n\nexport type Headers = Record\n\nexport interface Cookie {\n url?: string\n domain?: string\n name: string\n value: string\n path?: string\n expires?: number\n size?: number\n httpOnly?: boolean\n secure?: boolean\n session?: boolean\n}\n\nexport interface CookieQuery {\n name: string\n path?: string\n expires?: number\n size?: number\n httpOnly?: boolean\n secure?: boolean\n session?: boolean\n}\n\n// https://chromedevtools.github.io/devtools-protocol/tot/Page/#method-printToPDF\nexport interface PdfOptions {\n landscape?: boolean\n displayHeaderFooter?: boolean\n printBackground?: boolean\n scale?: number\n paperWidth?: number\n paperHeight?: number\n marginTop?: number\n marginBottom?: number\n marginLeft?: number\n marginRight?: number\n pageRanges?: string\n ignoreInvalidPageRanges?: boolean\n filePath?: string // for internal use\n}\n\nexport interface ScreenshotOptions {\n filePath?: string\n omitBackground?: boolean\n}\n\nexport type Quad = Array\n\nexport interface ShapeOutsideInfo {\n bounds: Quad\n shape: Array\n marginShape: Array\n}\n\nexport interface BoxModel {\n content: Quad\n padding: Quad\n border: Quad\n margin: Quad\n width: number\n height: number\n shapeOutside: ShapeOutsideInfo\n}\n\nexport interface Viewport {\n x: number\n y: number\n width: number\n height: number\n scale: number\n}\n" }, { "path": "src/util.test.ts", "content": "import * as fs from 'fs'\nimport * as os from 'os'\nimport * as CDP from 'chrome-remote-interface'\nimport test from 'ava'\nimport Chromeless from '../src'\n\nconst testHtml = fs.readFileSync('./src/__tests__/test.html')\nconst testUrl = `data:text/html,${testHtml}`\n\nconst getPngMetaData = async (filePath): Promise => {\n const fd = fs.openSync(filePath, 'r')\n return await new Promise(resolve => {\n fs.read(fd, Buffer.alloc(24), 0, 24, 0, (err, bytesRead, buffer) =>\n resolve({\n width: buffer.readUInt32BE(16),\n height: buffer.readUInt32BE(20),\n }),\n )\n })\n}\n\n// POC\ntest('evaluate (document.title)', async t => {\n const chromeless = new Chromeless({ launchChrome: false })\n const title = await chromeless.goto(testUrl).evaluate(() => document.title)\n\n await chromeless.end()\n\n t.is(title, 'Title')\n})\n\ntest('screenshot and pdf path', async t => {\n const chromeless = new Chromeless({ launchChrome: false })\n const screenshot = await chromeless.goto(testUrl).screenshot()\n const pdf = await chromeless.goto(testUrl).pdf()\n\n await chromeless.end()\n\n const regex = new RegExp(os.tmpdir().replace(/\\\\/g, '\\\\\\\\'))\n\n t.regex(screenshot, regex)\n t.regex(pdf, regex)\n})\n\ntest('screenshot by selector', async t => {\n const version = await CDP.Version()\n const versionMajor = parseInt(/Chrome\\/(\\d+)/.exec(version['User-Agent'])[1])\n // clipping will only work on chrome 61+\n\n const chromeless = new Chromeless({ launchChrome: false })\n const screenshot = await chromeless.goto(testUrl).screenshot('img')\n\n await chromeless.end()\n\n const png = await getPngMetaData(screenshot)\n t.is(png.width, versionMajor > 60 ? 512 : 1440)\n t.is(png.height, versionMajor > 60 ? 512 : 900)\n})\n" }, { "path": "src/util.ts", "content": "import * as fs from 'fs'\nimport * as os from 'os'\nimport * as path from 'path'\nimport * as cuid from 'cuid'\nimport {\n Client,\n Cookie,\n DeviceMetrics,\n PdfOptions,\n BoxModel,\n Viewport,\n Headers,\n ScreenshotOptions,\n} from './types'\nimport * as CDP from 'chrome-remote-interface'\nimport * as AWS from 'aws-sdk'\n\nexport const version: string = ((): string => {\n if (fs.existsSync(path.join(__dirname, '../package.json'))) {\n // development (look in /src)\n return require('../package.json').version\n } else {\n // production (look in /dist/src)\n return require('../../package.json').version\n }\n})()\n\nexport async function setViewport(\n client: Client,\n viewport: DeviceMetrics = { width: 1, height: 1, scale: 1 },\n): Promise {\n const config: any = {\n deviceScaleFactor: 1,\n mobile: false,\n scale: viewport.scale || 1,\n fitWindow: false, // as we cannot resize the window, `fitWindow: false` is needed in order for the viewport to be resizable\n }\n\n const { host, port } = client\n const versionResult = await CDP.Version({ host, port })\n const isHeadless = versionResult['User-Agent'].includes('Headless')\n\n if (viewport.height && viewport.width) {\n config.height = viewport.height\n config.width = viewport.width\n } else if (isHeadless) {\n // just apply default value in headless mode to maintain original browser viewport\n config.height = 900\n config.width = 1440\n } else {\n config.height = await evaluate(\n client,\n (() => window.innerHeight).toString(),\n )\n config.width = await evaluate(client, (() => window.innerWidth).toString())\n }\n\n await client.Emulation.setDeviceMetricsOverride(config)\n await client.Emulation.setVisibleSize({\n width: config.width,\n height: config.height,\n })\n return\n}\n\nexport async function waitForNode(\n client: Client,\n selector: string,\n waitTimeout: number,\n): Promise {\n const { Runtime } = client\n const getNode = `selector => {\n return document.querySelector(selector)\n }`\n\n const result = await Runtime.evaluate({\n expression: `(${getNode})(\\`${selector}\\`)`,\n })\n\n if (result.result.value === null) {\n const start = new Date().getTime()\n return new Promise((resolve, reject) => {\n const interval = setInterval(async () => {\n if (new Date().getTime() - start > waitTimeout) {\n clearInterval(interval)\n reject(\n new Error(`wait(\"${selector}\") timed out after ${waitTimeout}ms`),\n )\n }\n\n const result = await Runtime.evaluate({\n expression: `(${getNode})(\\`${selector}\\`)`,\n })\n\n if (result.result.value !== null) {\n clearInterval(interval)\n resolve()\n }\n }, 500)\n })\n } else {\n return\n }\n}\n\nexport async function wait(timeout: number): Promise {\n return new Promise((resolve, reject) => setTimeout(resolve, timeout))\n}\n\nexport async function waitForPromise(\n promise: Promise,\n waitTimeout: number,\n label?: string,\n): Promise {\n return new Promise((resolve, reject) => {\n let fullfilled = false\n setTimeout(() => {\n fullfilled = true\n reject(\n new Error(\n `wait(${label || 'Promise'}) timed out after ${waitTimeout}ms`,\n ),\n )\n }, waitTimeout)\n return promise\n .then(res => (fullfilled ? void 0 : resolve(res)))\n .catch(err => (fullfilled ? void 0 : reject(err)))\n })\n}\n\nexport function eventToPromise() {\n let resolve\n const promise = new Promise(res => {\n resolve = res\n })\n return {\n onEvent(...args) {\n resolve(args.length > 1 ? args : args[0])\n },\n fired() {\n return promise\n },\n }\n}\n\nexport async function nodeExists(\n client: Client,\n selector: string,\n): Promise {\n const { Runtime } = client\n const exists = `selector => {\n return !!document.querySelector(selector)\n }`\n\n const expression = `(${exists})(\\`${selector}\\`)`\n\n const result = await Runtime.evaluate({\n expression,\n })\n\n return result.result.value\n}\n\nexport async function getClientRect(client, selector): Promise {\n const { Runtime } = client\n\n const code = `selector => {\n const element = document.querySelector(selector)\n if (!element) {\n return undefined\n }\n\n const rect = element.getBoundingClientRect()\n return JSON.stringify({\n left: rect.left,\n top: rect.top,\n right: rect.right,\n bottom: rect.bottom,\n height: rect.height,\n width: rect.width,\n })\n }`\n\n const expression = `(${code})(\\`${selector}\\`)`\n const result = await Runtime.evaluate({ expression })\n\n if (!result.result.value) {\n throw new Error(`No element found for selector: ${selector}`)\n }\n\n return JSON.parse(result.result.value) as ClientRect\n}\n\nexport async function click(\n client: Client,\n selector: string,\n scale: number,\n x?: number,\n y?: number,\n) {\n const clientRect = await getClientRect(client, selector)\n const { Input } = client\n if (x === undefined) x = clientRect.width / 2\n if (y === undefined) y = clientRect.height / 2\n const options = {\n x: Math.round((clientRect.left + x) * scale),\n y: Math.round((clientRect.top + y) * scale),\n button: 'left',\n clickCount: 1,\n }\n\n await Input.dispatchMouseEvent({\n ...options,\n type: 'mousePressed',\n })\n await Input.dispatchMouseEvent({\n ...options,\n type: 'mouseReleased',\n })\n}\n\nexport async function focus(client: Client, selector: string): Promise {\n const { DOM } = client\n const dom = await DOM.getDocument()\n const node = await DOM.querySelector({\n nodeId: dom.root.nodeId,\n selector: selector,\n })\n await DOM.focus(node)\n}\n\nexport async function evaluate(\n client: Client,\n fn: string,\n ...args: any[]\n): Promise {\n const { Runtime } = client\n const jsonArgs = JSON.stringify(args)\n const argStr = jsonArgs.substr(1, jsonArgs.length - 2)\n\n const expression = `\n (() => {\n const expressionResult = (${fn})(${argStr});\n if (expressionResult && expressionResult.then) {\n expressionResult.catch((error) => { throw new Error(error); });\n return expressionResult;\n }\n return Promise.resolve(expressionResult);\n })();\n `\n\n const result = await Runtime.evaluate({\n expression,\n returnByValue: true,\n awaitPromise: true,\n })\n\n if (result && result.exceptionDetails) {\n throw new Error(\n result.exceptionDetails.exception.value ||\n result.exceptionDetails.exception.description,\n )\n }\n\n if (result && result.result) {\n return result.result.value\n }\n\n return null\n}\n\nexport async function type(\n client: Client,\n text: string,\n selector?: string,\n): Promise {\n if (selector) {\n await focus(client, selector)\n await wait(500)\n }\n\n const { Input } = client\n\n for (let i = 0; i < text.length; i++) {\n const char = text[i]\n const options = {\n type: 'char',\n text: char,\n unmodifiedText: char,\n }\n await Input.dispatchKeyEvent(options)\n }\n}\n\nexport async function press(\n client: Client,\n keyCode: number,\n count?: number,\n modifiers?: any,\n): Promise {\n const { Input } = client\n\n if (count === undefined) {\n count = 1\n }\n\n const options = {\n nativeVirtualKeyCode: keyCode,\n windowsVirtualKeyCode: keyCode,\n }\n\n if (modifiers) {\n options['modifiers'] = modifiers\n }\n\n for (let i = 0; i < count; i++) {\n await Input.dispatchKeyEvent({\n ...options,\n type: 'rawKeyDown',\n })\n await Input.dispatchKeyEvent({\n ...options,\n type: 'keyUp',\n })\n }\n}\n\nexport async function getValue(\n client: Client,\n selector: string,\n): Promise {\n const { Runtime } = client\n const browserCode = `selector => {\n return document.querySelector(selector).value\n }`\n const expression = `(${browserCode})(\\`${selector}\\`)`\n const result = await Runtime.evaluate({\n expression,\n })\n\n return result.result.value\n}\n\nexport async function scrollTo(\n client: Client,\n x: number,\n y: number,\n): Promise {\n const { Runtime } = client\n const browserCode = `(x, y) => {\n return window.scrollTo(x, y)\n }`\n const expression = `(${browserCode})(${x}, ${y})`\n await Runtime.evaluate({\n expression,\n })\n}\n\nexport async function scrollToElement(\n client: Client,\n selector: string,\n): Promise {\n const clientRect = await getClientRect(client, selector)\n\n return scrollTo(client, clientRect.left, clientRect.top)\n}\n\nexport async function setHtml(client: Client, html: string): Promise {\n const { Page } = client\n\n const { frameTree: { frame: { id: frameId } } } = await Page.getResourceTree()\n await Page.setDocumentContent({ frameId, html })\n}\n\nexport async function getCookies(\n client: Client,\n nameOrQuery?: string | Cookie,\n): Promise {\n const { Network } = client\n\n const fn = () => location.href\n\n const url = (await evaluate(client, `${fn}`)) as string\n\n const result = await Network.getCookies([url])\n const cookies = result.cookies\n\n if (typeof nameOrQuery !== 'undefined' && typeof nameOrQuery === 'string') {\n const filteredCookies: Cookie[] = cookies.filter(\n cookie => cookie.name === nameOrQuery,\n )\n return filteredCookies\n }\n return cookies\n}\n\nexport async function getAllCookies(client: Client): Promise {\n const { Network } = client\n\n const result = await Network.getAllCookies()\n return result.cookies\n}\n\nexport async function setCookies(\n client: Client,\n cookies: Cookie[],\n): Promise {\n const { Network } = client\n\n for (const cookie of cookies) {\n await Network.setCookie({\n ...cookie,\n url: cookie.url ? cookie.url : getUrlFromCookie(cookie),\n })\n }\n}\n\nexport async function setExtraHTTPHeaders(\n client: Client,\n headers: Headers,\n): Promise {\n const { Network } = client\n await Network.setExtraHTTPHeaders({ headers })\n}\n\nexport async function mousedown(\n client: Client,\n selector: string,\n scale: number,\n) {\n const clientRect = await getClientRect(client, selector)\n const { Input } = client\n\n const options = {\n x: Math.round((clientRect.left + clientRect.width / 2) * scale),\n y: Math.round((clientRect.top + clientRect.height / 2) * scale),\n button: 'left',\n clickCount: 1,\n }\n\n await Input.dispatchMouseEvent({\n ...options,\n type: 'mousePressed',\n })\n}\n\nexport async function mouseup(client: Client, selector: string, scale: number) {\n const clientRect = await getClientRect(client, selector)\n const { Input } = client\n\n const options = {\n x: Math.round((clientRect.left + clientRect.width / 2) * scale),\n y: Math.round((clientRect.top + clientRect.height / 2) * scale),\n button: 'left',\n clickCount: 1,\n }\n\n await Input.dispatchMouseEvent({\n ...options,\n type: 'mouseReleased',\n })\n}\n\nfunction getUrlFromCookie(cookie: Cookie) {\n const domain = cookie.domain.slice(1, cookie.domain.length)\n return `https://${domain}`\n}\n\nexport async function deleteCookie(\n client: Client,\n name: string,\n url: string,\n): Promise {\n const { Network } = client\n\n await Network.deleteCookie({ cookieName: name, url })\n}\n\nexport async function clearCookies(client: Client): Promise {\n const { Network } = client\n\n await Network.clearBrowserCookies()\n}\n\nexport async function getBoxModel(\n client: Client,\n selector: string,\n): Promise {\n const { DOM } = client\n const { root: { nodeId: documentNodeId } } = await DOM.getDocument()\n const { nodeId } = await DOM.querySelector({\n selector: selector,\n nodeId: documentNodeId,\n })\n\n const { model } = await DOM.getBoxModel({ nodeId })\n\n return model\n}\n\nexport function boxModelToViewPort(model: BoxModel, scale: number): Viewport {\n return {\n x: model.content[0],\n y: model.content[1],\n width: model.width,\n height: model.height,\n scale,\n }\n}\n\nexport async function screenshot(\n client: Client,\n selector: string,\n options: ScreenshotOptions,\n): Promise {\n const { Page } = client\n\n const captureScreenshotOptions = {\n format: 'png',\n fromSurface: true,\n clip: undefined,\n }\n\n if (selector) {\n const model = await getBoxModel(client, selector)\n captureScreenshotOptions.clip = boxModelToViewPort(model, 1)\n }\n if (options && options.omitBackground)\n client.Emulation.setDefaultBackgroundColorOverride({\n color: { r: 0, g: 0, b: 0, a: 0 },\n })\n const screenshot = await Page.captureScreenshot(captureScreenshotOptions)\n if (options && options.omitBackground)\n client.Emulation.setDefaultBackgroundColorOverride()\n return screenshot.data\n}\n\nexport async function html(client: Client): Promise {\n const { DOM } = client\n\n const { root: { nodeId } } = await DOM.getDocument()\n const { outerHTML } = await DOM.getOuterHTML({ nodeId })\n return outerHTML\n}\n\nexport async function htmlUrl(client: Client): Promise {\n const { DOM } = client\n\n const { root: { nodeId } } = await DOM.getDocument()\n const { outerHTML } = await DOM.getOuterHTML({ nodeId })\n return outerHTML\n}\n\nexport async function pdf(\n client: Client,\n options?: PdfOptions,\n): Promise {\n const { Page } = client\n\n const pdf = await Page.printToPDF(options)\n\n return pdf.data\n}\n\nexport async function clearInput(\n client: Client,\n selector: string,\n): Promise {\n await wait(500)\n await focus(client, selector)\n\n const { Input } = client\n\n const text = await getValue(client, selector)\n\n const optionsDelete = {\n nativeVirtualKeyCode: 46,\n windowsVirtualKeyCode: 46,\n }\n\n const optionsBackspace = {\n nativeVirtualKeyCode: 8,\n windowsVirtualKeyCode: 8,\n }\n\n for (let i = 0; i < text.length; i++) {\n await Input.dispatchKeyEvent({\n ...optionsDelete,\n type: 'rawKeyDown',\n })\n Input.dispatchKeyEvent({\n ...optionsDelete,\n type: 'keyUp',\n })\n await Input.dispatchKeyEvent({\n ...optionsBackspace,\n type: 'rawKeyDown',\n })\n Input.dispatchKeyEvent({\n ...optionsBackspace,\n type: 'keyUp',\n })\n }\n}\n\nexport async function setFileInput(\n client: Client,\n selector: string,\n files: string[],\n): Promise {\n const { DOM } = client\n const dom = await DOM.getDocument()\n const node = await DOM.querySelector({\n nodeId: dom.root.nodeId,\n selector: selector,\n })\n return await DOM.setFileInputFiles({ files: files, nodeId: node.nodeId })\n}\n\nexport function getDebugOption(): boolean {\n if (\n process &&\n process.env &&\n process.env['DEBUG'] &&\n process.env['DEBUG'].includes('chromeless')\n ) {\n return true\n }\n\n return false\n}\n\nexport function writeToFile(\n data: string,\n extension: string,\n filePathOverride: string,\n): string {\n const filePath =\n filePathOverride || path.join(os.tmpdir(), `${cuid()}.${extension}`)\n fs.writeFileSync(filePath, Buffer.from(data, 'base64'))\n return filePath\n}\n\nfunction getS3BucketName() {\n return process.env['CHROMELESS_S3_BUCKET_NAME']\n}\n\nfunction getS3BucketUrl() {\n return process.env['CHROMELESS_S3_BUCKET_URL']\n}\n\nfunction getS3ObjectKeyPrefix() {\n return process.env['CHROMELESS_S3_OBJECT_KEY_PREFIX'] || ''\n}\n\nfunction getS3FilesPermissions() {\n return process.env['CHROMELESS_S3_OBJECT_ACL'] || 'public-read'\n}\n\nexport function isS3Configured() {\n return getS3BucketName() && getS3BucketUrl()\n}\n\nconst s3ContentTypes = {\n 'image/png': {\n extension: 'png',\n },\n 'application/pdf': {\n extension: 'pdf',\n },\n 'text/html': {\n extension: 'html',\n },\n}\n\nexport async function uploadToS3(\n data: string,\n contentType: string,\n): Promise {\n const s3ContentType = s3ContentTypes[contentType]\n if (!s3ContentType) {\n throw new Error(`Unknown S3 Content type ${contentType}`)\n }\n const s3Path = `${getS3ObjectKeyPrefix()}${cuid()}.${s3ContentType.extension}`\n const s3 = new AWS.S3()\n await s3\n .putObject({\n Bucket: getS3BucketName(),\n Key: s3Path,\n ContentType: contentType,\n ACL: getS3FilesPermissions(),\n Body: Buffer.from(data, contentType === 'text/html' ? 'utf8' : 'base64'),\n })\n .promise()\n\n return `https://${getS3BucketUrl()}/${s3Path}`\n}\n" }, { "path": "tsconfig.json", "content": "{\n \"compilerOptions\": {\n \"module\": \"commonjs\",\n \"target\": \"es5\",\n \"moduleResolution\": \"node\",\n \"sourceMap\": true,\n \"outDir\": \"dist\",\n \"lib\": [\"es6\", \"dom\"],\n \"strictNullChecks\": false,\n \"pretty\": true,\n \"rootDir\": \".\",\n \"forceConsistentCasingInFileNames\": true\n },\n \"exclude\": [\"node_modules\", \"node_modules/**\", \"dist\"],\n \"include\": [\"./src/**/*.ts\", \"./examples/**/*.ts\"]\n}\n" }, { "path": "tslint.json", "content": "{\n \"rules\": {\n \"class-name\": true,\n \"comment-format\": [true, \"check-space\"],\n \"no-var-keyword\": true,\n \"no-internal-module\": true,\n \"no-null-keyword\": false,\n \"prefer-const\": true,\n \"jsdoc-format\": true\n }\n}\n" } ]