[ { "path": ".dockerignore", "content": ".DS_Store\n.idea\n.trash-cache\nbin\nstate\nbuild\nimages/*/build\nscripts/images/*/dist/\ndist\ntests/integration/.venv*\ntests/integration/.tox\n*/*/*/*.pyc\n*/*/*/__pycache__\n.trash-cache\nvendor/*/*/*/.git\ntmp\ndocs/_site\n" }, { "path": ".github/ISSUE_TEMPLATE.md", "content": "**BurmillaOS Version: (ros os version)**\n\n**Where are you running BurmillaOS? (docker-machine, AWS, GCE, baremetal, etc.)**\n\n**Which processor architecture you are using?**\n\n**Do you use some extra hardware? (GPU, etc)?**\n\n**Which console you use (default, ubuntu, centos, etc..)**\n\n**Do you use some service(s) which are not enabled by default?**\n\n**Have you installed some extra tools to console?**\n\n**Do you use some other customizations?**\n\n**Please share copy of your cloud-init (remember remove all sensitive data first)**\n```yaml\n\n```\n" }, { "path": ".github/workflows/create-release.yml", "content": "name: release\n\non:\n workflow_dispatch:\n\njobs:\n build:\n runs-on: ubuntu-22.04\n steps:\n - uses: actions/checkout@v2\n with:\n fetch-depth: '0'\n\n - name: Install github-release\n run: |\n sudo wget https://github.com/github-release/github-release/releases/download/v0.9.0/linux-amd64-github-release.bz2 -O /usr/local/bin/github-release.bz2\n sudo bunzip2 /usr/local/bin/github-release.bz2\n sudo chmod 0755 /usr/local/bin/github-release\n\n - name: Build OS\n run: |\n export VERSION=$(git describe --exact-match --tags $(git log -n1 --pretty='%h'))\n if [ -z \"$VERSION\" ]; then\n echo \"Build is not started from tag. Will exit...\"\n exit 1\n fi\n export OS_FIRMWARE=${{ github.event.inputs.firmware }}\n export ARCH=amd64\n make release\n\n - name: Login to DockerHub\n uses: docker/login-action@v1\n with:\n username: ${{ secrets.DOCKER_USERNAME }}\n password: ${{ secrets.DOCKER_PASSWORD }}\n\n - name: Publish release\n run: ${PWD}/dist/publish.sh\n env:\n GITHUB_TOKEN: ${{ secrets.OS_RELEASE_TOKEN }}\n" }, { "path": ".github/workflows/pull-request-validation.yml", "content": "name: PR\non: pull_request\n\njobs:\n build:\n runs-on: ubuntu-latest\n steps:\n - uses: actions/checkout@v2\n\n - name: Test with dapper\n run: |\n make pr-validation\n" }, { "path": ".gitignore", "content": ".DS_Store\n/assets/ca.crt\n/state\n/bin\n/build\n/dist\n/gopath\n/images/*/build\n/scripts/images/vmware/assets\n.dockerfile\n*.swp\n/tests/integration/MANIFEST\n/tests/integration/.venv*\n/tests/integration/.tox\n/tests/integration/.idea\n*.pyc\n__pycache__\n/.dapper\n/.trash-cache\n/trash.lock\n.idea\n.trash-conf\n/Dockerfile.dapper*\n!/Dockerfile.dapper\nscripts/images/raspberry-pi-hypriot64/Dockerfile.dapper*\n" }, { "path": "Dockerfile.dapper", "content": "FROM ubuntu:bionic\n# FROM arm64=arm64v8/ubuntu:bionic\n\n# get the apt-cacher proxy set\nARG APTPROXY=\nARG APT_ARCHIVE_SOURCE=\"archive.ubuntu.com\"\n\nRUN echo \"Acquire::http { Proxy \\\"$APTPROXY\\\"; };\" >> /etc/apt/apt.conf.d/01proxy \\\n && cat /etc/apt/apt.conf.d/01proxy \\\n && sed -i \"s|archive.ubuntu.com|${APT_ARCHIVE_SOURCE}|\" /etc/apt/sources.list \\\n && cat /etc/apt/sources.list \\\n && apt-get update \\\n && apt-get install -y --no-install-recommends \\\n build-essential \\\n ca-certificates \\\n cpio \\\n curl \\\n dosfstools \\\n gccgo \\\n genisoimage \\\n gettext \\\n git \\\n isolinux \\\n less \\\n libblkid-dev \\\n libmount-dev \\\n libselinux1-dev \\\n locales \\\n module-init-tools \\\n mtools \\\n openssh-client \\\n pkg-config \\\n qemu \\\n qemu-kvm \\\n rsync \\\n sudo \\\n syslinux-common \\\n vim \\\n wget \\\n xorriso \\\n xz-utils \\\n telnet\n\n########## Dapper Configuration #####################\n\nENV DAPPER_ENV VERSION DEV_BUILD RUNTEST DEBUG APTPROXY ENGINE_REGISTRY_MIRROR KERNEL_CHECK APPEND_SYSTEM_IMAGES APPEND_USER_IMAGES\nENV DAPPER_DOCKER_SOCKET true\nENV DAPPER_SOURCE /go/src/github.com/burmilla/os\nENV DAPPER_OUTPUT ./bin ./dist ./build/initrd ./build/kernel\nENV DAPPER_RUN_ARGS --privileged\nENV TRASH_CACHE ${DAPPER_SOURCE}/.trash-cache\nENV SHELL /bin/bash\nWORKDIR ${DAPPER_SOURCE}\n\n########## General Configuration #####################\nARG DAPPER_HOST_ARCH=amd64\nARG HOST_ARCH=${DAPPER_HOST_ARCH}\nARG ARCH=${HOST_ARCH}\n\nARG OS_REPO=burmilla\nARG HOSTNAME_DEFAULT=burmilla\nARG DISTRIB_ID=BurmillaOS\n\nARG KERNEL_VERSION=5.10.248-burmilla\nARG KERNEL_URL_amd64=https://github.com/burmilla/os-kernel/releases/download/v${KERNEL_VERSION}/linux-${KERNEL_VERSION}-x86.tar.gz\nARG KERNEL_URL_arm64=https://github.com/burmilla/os-kernel/releases/download/v${KERNEL_VERSION}/linux-${KERNEL_VERSION}-arm64.tar.gz\n\nARG BUILD_DOCKER_URL_amd64=https://download.docker.com/linux/static/stable/x86_64/docker-26.1.4.tgz\nARG BUILD_DOCKER_URL_arm64=https://download.docker.com/linux/static/stable/aarch64/docker-26.1.4.tgz\n\nARG OS_RELEASES_YML=https://raw.githubusercontent.com/burmilla/releases/v2.0.x\n\nARG OS_SERVICES_REPO=https://raw.githubusercontent.com/${OS_REPO}/os-services\nARG IMAGE_NAME=${OS_REPO}/os\n\nARG OS_CONSOLE=default\nARG OS_AUTOFORMAT=false\nARG OS_FIRMWARE=true\n\nARG OS_BASE_URL_amd64=https://github.com/burmilla/os-base/releases/download/v2023.05-1/os-base_amd64.tar.xz\nARG OS_BASE_URL_arm64=https://github.com/burmilla/os-base/releases/download/v2023.05-1/os-base_arm64.tar.xz\n\nARG OS_INITRD_BASE_URL_amd64=https://github.com/burmilla/os-initrd-base/releases/download/v2023.02.10-2/os-initrd-base-amd64.tar.gz\nARG OS_INITRD_BASE_URL_arm64=https://github.com/burmilla/os-initrd-base/releases/download/v2023.02.10-2/os-initrd-base-arm64.tar.gz\n\nARG SYSTEM_DOCKER_VERSION=17.06.107\nARG SYSTEM_DOCKER_URL_amd64=https://github.com/burmilla/os-system-docker/releases/download/${SYSTEM_DOCKER_VERSION}/docker-amd64-${SYSTEM_DOCKER_VERSION}.tgz\nARG SYSTEM_DOCKER_URL_arm64=https://github.com/burmilla/os-system-docker/releases/download/${SYSTEM_DOCKER_VERSION}/docker-arm64-${SYSTEM_DOCKER_VERSION}.tgz\n\nARG AZURE_SERVICE=false\nARG PROXMOXVE_SERVICE=false\nARG SKIP_BUILD=false\n######################################################\n\n# Set up environment and export all ARGS as ENV\nENV ARCH=${ARCH} \\\n HOST_ARCH=${HOST_ARCH} \\\n XZ_DEFAULTS=\"-T0\"\n\nENV BUILD_DOCKER_URL=BUILD_DOCKER_URL_${ARCH} \\\n BUILD_DOCKER_URL_amd64=${BUILD_DOCKER_URL_amd64} \\\n BUILD_DOCKER_URL_arm64=${BUILD_DOCKER_URL_arm64} \\\n DAPPER_HOST_ARCH=${DAPPER_HOST_ARCH} \\\n DISTRIB_ID=${DISTRIB_ID} \\\n DOWNLOADS=/usr/src/downloads \\\n GOPATH=/go \\\n GO_VERSION=1.19.5 \\\n GO111MODULE=off \\\n GOARCH=$ARCH \\\n HOSTNAME_DEFAULT=${HOSTNAME_DEFAULT} \\\n IMAGE_NAME=${IMAGE_NAME} \\\n KERNEL_VERSION=${KERNEL_VERSION} \\\n KERNEL_URL=KERNEL_URL_${ARCH} \\\n KERNEL_URL_amd64=${KERNEL_URL_amd64} \\\n KERNEL_URL_arm64=${KERNEL_URL_arm64} \\\n OS_BASE_URL=OS_BASE_URL_${ARCH} \\\n OS_BASE_URL_amd64=${OS_BASE_URL_amd64} \\\n OS_BASE_URL_arm64=${OS_BASE_URL_arm64} \\\n OS_INITRD_BASE_URL=OS_INITRD_BASE_URL_${ARCH} \\\n OS_INITRD_BASE_URL_amd64=${OS_INITRD_BASE_URL_amd64} \\\n OS_INITRD_BASE_URL_arm64=${OS_INITRD_BASE_URL_arm64} \\\n OS_RELEASES_YML=${OS_RELEASES_YML} \\\n OS_REPO=${OS_REPO} \\\n OS_SERVICES_REPO=${OS_SERVICES_REPO} \\\n OS_CONSOLE=${OS_CONSOLE} \\\n OS_AUTOFORMAT=${OS_AUTOFORMAT} \\\n OS_FIRMWARE=${OS_FIRMWARE} \\\n REPO_VERSION=master \\\n SYSTEM_DOCKER_URL=SYSTEM_DOCKER_URL_${ARCH} \\\n SYSTEM_DOCKER_URL_amd64=${SYSTEM_DOCKER_URL_amd64} \\\n SYSTEM_DOCKER_URL_arm64=${SYSTEM_DOCKER_URL_arm64} \\\n AZURE_SERVICE=${AZURE_SERVICE} \\\n PROXMOXVE_SERVICE=${PROXMOXVE_SERVICE} \\\n SKIP_BUILD=${SKIP_BUILD}\nENV PATH=${GOPATH}/bin:/usr/local/go/bin:$PATH\nENV GO111MODULE=off\n\nRUN mkdir -p ${DOWNLOADS}\n\n# Download kernel\nRUN rm /bin/sh && ln -s /bin/bash /bin/sh\nRUN echo \"... Downloading ${!KERNEL_URL}\"; \\\n if [ \"${!KERNEL_URL}\" != \"skip\" ]; then \\\n curl -fL ${!KERNEL_URL} > ${DOWNLOADS}/kernel.tar.gz \\\n ;fi\n\n# Install Go\nRUN curl -L https://dl.google.com/go/go${GO_VERSION}.linux-${HOST_ARCH}.tar.gz | tar -xzf - -C /usr/local && \\\n go get github.com/burmilla/trash\n\n# Install Host Docker\nRUN curl -fL ${!BUILD_DOCKER_URL} > /tmp/docker.tgz && \\\n tar zxvf /tmp/docker.tgz --strip-components=1 -C /usr/bin/ && \\\n chmod +x /usr/bin/docker\n\n# Install dapper\nRUN curl -sL https://releases.rancher.com/dapper/v0.5.4/dapper-`uname -s`-`uname -m | sed 's/arm.*/arm/'` > /usr/bin/dapper && \\\n chmod +x /usr/bin/dapper\n\nRUN cd ${DOWNLOADS} && \\\n curl -pfL ${!OS_BASE_URL} | tar xvJf -\n\nENTRYPOINT [\"./scripts/entry\"]\nCMD [\"ci\"]\n" }, { "path": "LICENSE", "content": "\n Apache License\n Version 2.0, January 2004\n http://www.apache.org/licenses/\n\n TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION\n\n 1. Definitions.\n\n \"License\" shall mean the terms and conditions for use, reproduction,\n and distribution as defined by Sections 1 through 9 of this document.\n\n \"Licensor\" shall mean the copyright owner or entity authorized by\n the copyright owner that is granting the License.\n\n \"Legal Entity\" shall mean the union of the acting entity and all\n other entities that control, are controlled by, or are under common\n control with that entity. For the purposes of this definition,\n \"control\" means (i) the power, direct or indirect, to cause the\n direction or management of such entity, whether by contract or\n otherwise, or (ii) ownership of fifty percent (50%) or more of the\n outstanding shares, or (iii) beneficial ownership of such entity.\n\n \"You\" (or \"Your\") shall mean an individual or Legal Entity\n exercising permissions granted by this License.\n\n \"Source\" form shall mean the preferred form for making modifications,\n including but not limited to software source code, documentation\n source, and configuration files.\n\n \"Object\" form shall mean any form resulting from mechanical\n transformation or translation of a Source form, including but\n not limited to compiled object code, generated documentation,\n and conversions to other media types.\n\n \"Work\" shall mean the work of authorship, whether in Source or\n Object form, made available under the License, as indicated by a\n copyright notice that is included in or attached to the work\n (an example is provided in the Appendix below).\n\n \"Derivative Works\" shall mean any work, whether in Source or Object\n form, that is based on (or derived from) the Work and for which the\n editorial revisions, annotations, elaborations, or other modifications\n represent, as a whole, an original work of authorship. For the purposes\n of this License, Derivative Works shall not include works that remain\n separable from, or merely link (or bind by name) to the interfaces of,\n the Work and Derivative Works thereof.\n\n \"Contribution\" shall mean any work of authorship, including\n the original version of the Work and any modifications or additions\n to that Work or Derivative Works thereof, that is intentionally\n submitted to Licensor for inclusion in the Work by the copyright owner\n or by an individual or Legal Entity authorized to submit on behalf of\n the copyright owner. For the purposes of this definition, \"submitted\"\n means any form of electronic, verbal, or written communication sent\n to the Licensor or its representatives, including but not limited to\n communication on electronic mailing lists, source code control systems,\n and issue tracking systems that are managed by, or on behalf of, the\n Licensor for the purpose of discussing and improving the Work, but\n excluding communication that is conspicuously marked or otherwise\n designated in writing by the copyright owner as \"Not a Contribution.\"\n\n \"Contributor\" shall mean Licensor and any individual or Legal Entity\n on behalf of whom a Contribution has been received by Licensor and\n subsequently incorporated within the Work.\n\n 2. Grant of Copyright License. Subject to the terms and conditions of\n this License, each Contributor hereby grants to You a perpetual,\n worldwide, non-exclusive, no-charge, royalty-free, irrevocable\n copyright license to reproduce, prepare Derivative Works of,\n publicly display, publicly perform, sublicense, and distribute the\n Work and such Derivative Works in Source or Object form.\n\n 3. Grant of Patent License. Subject to the terms and conditions of\n this License, each Contributor hereby grants to You a perpetual,\n worldwide, non-exclusive, no-charge, royalty-free, irrevocable\n (except as stated in this section) patent license to make, have made,\n use, offer to sell, sell, import, and otherwise transfer the Work,\n where such license applies only to those patent claims licensable\n by such Contributor that are necessarily infringed by their\n Contribution(s) alone or by combination of their Contribution(s)\n with the Work to which such Contribution(s) was submitted. If You\n institute patent litigation against any entity (including a\n cross-claim or counterclaim in a lawsuit) alleging that the Work\n or a Contribution incorporated within the Work constitutes direct\n or contributory patent infringement, then any patent licenses\n granted to You under this License for that Work shall terminate\n as of the date such litigation is filed.\n\n 4. Redistribution. You may reproduce and distribute copies of the\n Work or Derivative Works thereof in any medium, with or without\n modifications, and in Source or Object form, provided that You\n meet the following conditions:\n\n (a) You must give any other recipients of the Work or\n Derivative Works a copy of this License; and\n\n (b) You must cause any modified files to carry prominent notices\n stating that You changed the files; and\n\n (c) You must retain, in the Source form of any Derivative Works\n that You distribute, all copyright, patent, trademark, and\n attribution notices from the Source form of the Work,\n excluding those notices that do not pertain to any part of\n the Derivative Works; and\n\n (d) If the Work includes a \"NOTICE\" text file as part of its\n distribution, then any Derivative Works that You distribute must\n include a readable copy of the attribution notices contained\n within such NOTICE file, excluding those notices that do not\n pertain to any part of the Derivative Works, in at least one\n of the following places: within a NOTICE text file distributed\n as part of the Derivative Works; within the Source form or\n documentation, if provided along with the Derivative Works; or,\n within a display generated by the Derivative Works, if and\n wherever such third-party notices normally appear. The contents\n of the NOTICE file are for informational purposes only and\n do not modify the License. You may add Your own attribution\n notices within Derivative Works that You distribute, alongside\n or as an addendum to the NOTICE text from the Work, provided\n that such additional attribution notices cannot be construed\n as modifying the License.\n\n You may add Your own copyright statement to Your modifications and\n may provide additional or different license terms and conditions\n for use, reproduction, or distribution of Your modifications, or\n for any such Derivative Works as a whole, provided Your use,\n reproduction, and distribution of the Work otherwise complies with\n the conditions stated in this License.\n\n 5. Submission of Contributions. Unless You explicitly state otherwise,\n any Contribution intentionally submitted for inclusion in the Work\n by You to the Licensor shall be under the terms and conditions of\n this License, without any additional terms or conditions.\n Notwithstanding the above, nothing herein shall supersede or modify\n the terms of any separate license agreement you may have executed\n with Licensor regarding such Contributions.\n\n 6. Trademarks. This License does not grant permission to use the trade\n names, trademarks, service marks, or product names of the Licensor,\n except as required for reasonable and customary use in describing the\n origin of the Work and reproducing the content of the NOTICE file.\n\n 7. Disclaimer of Warranty. Unless required by applicable law or\n agreed to in writing, Licensor provides the Work (and each\n Contributor provides its Contributions) on an \"AS IS\" BASIS,\n WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or\n implied, including, without limitation, any warranties or conditions\n of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A\n PARTICULAR PURPOSE. You are solely responsible for determining the\n appropriateness of using or redistributing the Work and assume any\n risks associated with Your exercise of permissions under this License.\n\n 8. Limitation of Liability. In no event and under no legal theory,\n whether in tort (including negligence), contract, or otherwise,\n unless required by applicable law (such as deliberate and grossly\n negligent acts) or agreed to in writing, shall any Contributor be\n liable to You for damages, including any direct, indirect, special,\n incidental, or consequential damages of any character arising as a\n result of this License or out of the use or inability to use the\n Work (including but not limited to damages for loss of goodwill,\n work stoppage, computer failure or malfunction, or any and all\n other commercial damages or losses), even if such Contributor\n has been advised of the possibility of such damages.\n\n 9. Accepting Warranty or Additional Liability. While redistributing\n the Work or Derivative Works thereof, You may choose to offer,\n and charge a fee for, acceptance of support, warranty, indemnity,\n or other liability obligations and/or rights consistent with this\n License. However, in accepting such obligations, You may act only\n on Your own behalf and on Your sole responsibility, not on behalf\n of any other Contributor, and only if You agree to indemnify,\n defend, and hold each Contributor harmless for any liability\n incurred by, or claims asserted against, such Contributor by reason\n of your accepting any such warranty or additional liability.\n\n END OF TERMS AND CONDITIONS\n" }, { "path": "Makefile", "content": "TARGETS := $(shell ls scripts | grep -vE 'clean|run|help|release*|build-moby|run-moby')\n\n.dapper:\n\t@echo Downloading dapper\n\t@curl -sL https://releases.rancher.com/dapper/latest/dapper-`uname -s`-`uname -m|sed 's/v7l//'` > .dapper.tmp\n\t@@chmod +x .dapper.tmp\n\t@./.dapper.tmp -v\n\t@mv .dapper.tmp .dapper\n\n$(TARGETS): .dapper\n\t./.dapper $@\n\npr-validation: .dapper\n\tARCH=\"amd64\" \\\n\tKERNEL_URL_amd64=\"skip\" \\\n\tSKIP_BUILD=\"true\" \\\n\t./.dapper ci\n\ntrash: .dapper\n\t./.dapper -m bind trash\n\ntrash-keep: .dapper\n\t./.dapper -m bind trash -k\n\ndeps: trash\n\nbuild/initrd/.id: .dapper\n\t./.dapper prepare\n\nrun: build/initrd/.id .dapper\n\t./.dapper -m bind build-target\n\t./scripts/run\n\nbuild-moby:\n\t./scripts/build-moby\n\nrun-moby:\n\t./scripts/run-moby\n\nshell-bind: .dapper\n\t./.dapper -m bind -s\n\nclean:\n\t@./scripts/clean\n\nrelease: .dapper release-build\n\nrelease-build:\n\tmkdir -p dist\n\t./.dapper release\n\nrpi64: .dapper\n\t./scripts/release-rpi64\n\nvmware: .dapper\n\tmkdir -p dist\n\tOS_FIRMWARE=\"false\" \\\n\tAPPEND_SYSTEM_IMAGES=\"burmilla/os-openvmtools:11.2.0-5\" \\\n\t./.dapper release-vmware\n\nhyperv: .dapper\n\tmkdir -p dist\n\tOS_FIRMWARE=\"false\" \\\n\tAPPEND_SYSTEM_IMAGES=\"burmilla/os-hypervvmtools:v4.14.206-burmilla-1\" \\\n\t./.dapper release-hyperv\n\nazurebase: .dapper\n\tmkdir -p dist\n\tAZURE_SERVICE=\"true\" \\\n\tOS_FIRMWARE=\"false\" \\\n\tAPPEND_SYSTEM_IMAGES=\"burmilla/os-hypervvmtools:v4.14.206-burmilla-1 burmilla/os-waagent:v2.2.49.2-1\" \\\n\t./.dapper release-azurebase\n\n4glte: .dapper\n\tmkdir -p dist\n\tAPPEND_SYSTEM_IMAGES=\"burmilla/os-modemmanager:v1.6.4-1\" \\\n\t./.dapper release-4glte\n\nproxmoxve: .dapper\n\tmkdir -p dist\n\tPROXMOXVE_SERVICE=\"true\" \\\n\tOS_FIRMWARE=\"false\" \\\n\tAPPEND_SYSTEM_IMAGES=\"burmilla/os-qemuguestagent:v3.1.0-1\" \\\n\t./.dapper release-proxmoxve\n\nhelp:\n\t@./scripts/help\n\n.DEFAULT_GOAL := default\n\n.PHONY: $(TARGETS)\n" }, { "path": "README.md", "content": "# BurmillaOS\n\nBurmillaOS is successor of [RancherOS](//github.com/rancher/os) which reached end of life.\n\n![GitHub release](https://img.shields.io/github/v/release/burmilla/os.svg)\n[![Docker Pulls](https://img.shields.io/docker/pulls/burmilla/os.svg)](https://store.docker.com/community/images/burmilla/os)\n[![Go Report Card](https://goreportcard.com/badge/github.com/burmilla/os)](https://goreportcard.com/badge/github.com/burmilla/os)\n\nThe smallest, easiest way to run Docker in production at scale. Everything in BurmillaOS is a container managed by Docker. This includes system services such as udev and rsyslog. BurmillaOS includes only the bare minimum amount of software needed to run Docker. This keeps the binary download of BurmillaOS very small. Everything else can be pulled in dynamically through Docker.\n\n## How this works\n\nEverything in BurmillaOS is a Docker container. We accomplish this by launching two instances of\nDocker. One is what we call the system Docker which runs as the first process. System Docker then launches\na container that runs the user Docker. The user Docker is then the instance that gets primarily\nused to create containers. We created this separation because it seemed logical and also\nit would really be bad if somebody did `docker rm -f $(docker ps -qa)` and deleted the entire OS.\n\n![How it works](./howitworks.png \"How it works\")\n\n## Documentation for BurmillaOS\n\nPlease refer to our [BurmillaOS Documentation](https://burmilla.github.io) website to read all about BurmillaOS. It has detailed information on how BurmillaOS works, getting-started and other details.\n\nPlease submit any **BurmillaOS** bugs, issues, and feature requests to [burmilla/os](//github.com/burmilla/os/issues).\n\n## License\n\nCopyright (c) 2020-2024 [BurmillaOS community](https://burmillaos.org)\n\nCopyright (c) 2014-2020 [Rancher Labs, Inc.](http://rancher.com)\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n[http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n" }, { "path": "assets/rancher.key", "content": "-----BEGIN RSA PRIVATE KEY-----\nMIIEowIBAAKCAQEAvOcPbLWcoi0Kfw5FTun6sIkoWHI9QpSnbQqoB7X/jy6SZBUX\nkhbvMttcvnr9PYLEjEUa4xe8rdKVB1es53EIVXqrGbYHOVmxC2NgzmFBpkZ/wgrz\n216L6Aa0I0qK6pQZqbj8LErWC6/dl5/lVbDDUlCHoB2Ntg6YRmwyhvOb6ygfB8VM\nRiA8RQXbP7hPBYUsvsbKMk/41GQyuqYKth5xpeg/NVYiJSnnKTqVpVtwfn3mvfQA\nzcmTVbw82xxOaXCN1UcPLufVpqVjlIE+qmnDVQApfBqqQb0JPLMOzv1/Q0mRwimn\n3g/RuZPhmGwFM/dnylq8f5Tl31Fz0t/nPHUSBQIDAQABAoIBAGS4EhpVTvmNaF5M\nPpoP2TFNQCzAZHdeiVJzbxoFaQhvvXANau7iuZD1MyMAsouccK2VnvtcSaaoc/th\nPPh95QKmkBn6Wymx79rxlskTRAyi5DWS32ikpZYGFQAIG79tTa2XyyTWlf/POihB\nAedJgysdcuLlPwzGBVzvDZW0x/p+Ejs+etW0QBb1swcqheM9cc6RBoF/aLPyUK4i\n1ztVuzJTvTTV16xTNF93XFS177Y6toXZEaCBpuMg/XX0y0Fj4iAkSIqJoEV6MKeI\nSqQad/sVsLTwCsW+/so7jfRWtm5xRJOtNxpSUrGrNYuRBUr4VlXNZT4TOOS9BFEF\nAyTSBcECgYEA+9wnSZjEFgz/8x/xsyPCsKBhCu6nfV/mxVgTrRXuMtpzujAnKXsf\njEh1vtKH9UpbwM+gRYxZL+ZVjB2uE523hoDxqDfpVnWfItNs4OU4qougqUHBdsZe\n0t0Xjyl/17f7g7BWMXSWhTcoDlirGHtjvIDh0CXVfWvtcLaiQj0dAfUCgYEAwAH6\nJPZotxue8bUyglCrOyg3P0G9QgeQSabbCCKDyiGzKYTXqx1vxEZ+0RCKSg0D/spK\n2x7V0wearEOX/rCuQVw2r4oltUmbmq+BHYnXXz0hM0TMJs1BPZhvMhPGWq0lm1WL\nNKfAOU64hZQAPwf3Z+3B5jywQfOmwssOfAXr9dECgYBroKrRUo0I90kxNkdtTCzY\nmdCegVnlw+O0FW1jG+oMpTmrKQSzP0A+DID0qLcc5UfMX22YCt/aDk4kcFKBY3aX\n7eZXAn2eSulUUpFGke3jQ4PGkKkB/sdqyLxWm19caez7W5GZ1L618toVN2L2NVRr\nq4/UCTbwP/zZm9I/CCqrOQKBgQClQk5hd/BDAbP5B+L0RKhMX13FxTg217m5mrJU\nuxhBZmYFK0BRGCH1hlNqb9kGyVMR/l0VYeHaI2ZeNENjRACHYu3ygm3YLgWOytXP\nba+AWmXz8ZfhIbKwaD30lQ6ZRwPiQWtyI5wP9xBccDkSBzJLMlk8aCmwahyy9gB+\ngL5JsQKBgBT1ILAQvK2IGmwHFvUApXruARIvU4lrMQJ9tpYiPtpSNAPP73jUac68\nthh3zQYJfYDQbdbwnF41X6WPvbYwb7uH5PG/T2A78YSZQyMpCk+enaf8o0dOZEAH\njhnrn3KQFCRQXRUfm9O6N+S04S4uXT8++vlZucW7jEq8GW0nYxj/\n-----END RSA PRIVATE KEY-----\n" }, { "path": "assets/rancher.key.pub", "content": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC85w9stZyiLQp/DkVO6fqwiShYcj1ClKdtCqgHtf+PLpJkFReSFu8y21y+ev09gsSMRRrjF7yt0pUHV6zncQhVeqsZtgc5WbELY2DOYUGmRn/CCvPbXovoBrQjSorqlBmpuPwsStYLr92Xn+VVsMNSUIegHY22DphGbDKG85vrKB8HxUxGIDxFBds/uE8FhSy+xsoyT/jUZDK6pgq2HnGl6D81ViIlKecpOpWlW3B+fea99ADNyZNVvDzbHE5pcI3VRw8u59WmpWOUgT6qacNVACl8GqpBvQk8sw7O/X9DSZHCKafeD9G5k+GYbAUz92fKWrx/lOXfUXPS3+c8dRIF\n" }, { "path": "assets/scripts_ssh_config", "content": "StrictHostKeyChecking no\nUserKnownHostsFile /dev/null\nLogLevel quiet\n" }, { "path": "cmd/cloudinitexecute/authorize_ssh_keys.go", "content": "package cloudinitexecute\n\nimport (\n\t\"io/ioutil\"\n\t\"os\"\n\t\"path\"\n\t\"strconv\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n)\n\nconst (\n\tsshDirName = \".ssh\"\n\tauthorizedKeysFileName = \"authorized_keys\"\n)\n\nfunc authorizeSSHKeys(username string, authorizedKeys []string, name string) error {\n\tvar uid int\n\tvar gid int\n\tvar homeDir string\n\n\tbytes, err := ioutil.ReadFile(\"/etc/passwd\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor _, line := range strings.Split(string(bytes), \"\\n\") {\n\t\tif strings.HasPrefix(line, username) {\n\t\t\tsplit := strings.Split(line, \":\")\n\t\t\tif len(split) < 6 {\n\t\t\t\tbreak\n\t\t\t}\n\t\t\tuid, err = strconv.Atoi(split[2])\n\t\t\tif err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t\tgid, err = strconv.Atoi(split[3])\n\t\t\tif err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t\thomeDir = split[5]\n\t\t}\n\t}\n\n\tsshDir := path.Join(homeDir, sshDirName)\n\tauthorizedKeysFile := path.Join(sshDir, authorizedKeysFileName)\n\n\tif _, err := os.Stat(sshDir); os.IsNotExist(err) {\n\t\tif err = os.Mkdir(sshDir, 0700); err != nil {\n\t\t\treturn err\n\t\t}\n\t} else if err != nil {\n\t\treturn err\n\t}\n\n\tif err = os.Chown(sshDir, uid, gid); err != nil {\n\t\treturn err\n\t}\n\n\tfor _, authorizedKey := range authorizedKeys {\n\t\tif err = authorizeSSHKey(authorizedKey, authorizedKeysFile, uid, gid); err != nil {\n\t\t\tlog.Errorf(\"Failed to authorize SSH key %s: %v\", authorizedKey, err)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc authorizeSSHKey(authorizedKey, authorizedKeysFile string, uid, gid int) error {\n\tauthorizedKeysFileInfo, err := os.Stat(authorizedKeysFile)\n\tif os.IsNotExist(err) {\n\t\tkeysFile, err := os.Create(authorizedKeysFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif err = keysFile.Chmod(0600); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif err = keysFile.Close(); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tauthorizedKeysFileInfo, err = os.Stat(authorizedKeysFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t} else if err != nil {\n\t\treturn err\n\t}\n\n\tbytes, err := ioutil.ReadFile(authorizedKeysFile)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif !strings.Contains(string(bytes), authorizedKey) {\n\t\tbytes = append(bytes, []byte(authorizedKey)...)\n\t\tbytes = append(bytes, '\\n')\n\t}\n\n\tperm := authorizedKeysFileInfo.Mode().Perm()\n\tif err = util.WriteFileAtomic(authorizedKeysFile, bytes, perm); err != nil {\n\t\treturn err\n\t}\n\n\treturn os.Chown(authorizedKeysFile, uid, gid)\n}\n" }, { "path": "cmd/cloudinitexecute/cloudinitexecute.go", "content": "package cloudinitexecute\n\nimport (\n\t\"flag\"\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path\"\n\t\"strings\"\n\n\trancherConfig \"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/config/cloudinit/config\"\n\t\"github.com/burmilla/os/config/cloudinit/system\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"golang.org/x/net/context\"\n)\n\nconst (\n\tresizeStamp = \"/var/lib/rancher/resizefs.done\"\n\tsshKeyName = \"rancheros-cloud-config\"\n)\n\nvar (\n\tconsole bool\n\tpreConsole bool\n\tflags *flag.FlagSet\n)\n\nfunc init() {\n\tflags = flag.NewFlagSet(os.Args[0], flag.ContinueOnError)\n\tflags.BoolVar(&console, \"console\", false, \"apply console configuration\")\n\tflags.BoolVar(&preConsole, \"pre-console\", false, \"apply pre-console configuration\")\n}\n\nfunc Main() {\n\tflags.Parse(os.Args[1:])\n\n\tlog.InitLogger()\n\tlog.Infof(\"Running cloud-init-execute: pre-console=%v, console=%v\", preConsole, console)\n\n\tcfg := rancherConfig.LoadConfig()\n\n\tif !console && !preConsole {\n\t\tconsole = true\n\t\tpreConsole = true\n\t}\n\n\tif console {\n\t\tApplyConsole(cfg)\n\t}\n\tif preConsole {\n\t\tapplyPreConsole(cfg)\n\t}\n}\n\nfunc ApplyConsole(cfg *rancherConfig.CloudConfig) {\n\tif len(cfg.SSHAuthorizedKeys) > 0 {\n\t\tif err := authorizeSSHKeys(\"rancher\", cfg.SSHAuthorizedKeys, sshKeyName); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tif err := authorizeSSHKeys(\"docker\", cfg.SSHAuthorizedKeys, sshKeyName); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tWriteFiles(cfg, \"console\")\n\n\tfor _, mount := range cfg.Mounts {\n\t\tif len(mount) != 4 {\n\t\t\tlog.Errorf(\"Unable to mount %s: must specify exactly four arguments\", mount[1])\n\t\t}\n\n\t\tif mount[2] == \"nfs\" || mount[2] == \"nfs4\" {\n\t\t\tif err := os.MkdirAll(mount[1], 0755); err != nil {\n\t\t\t\tlog.Errorf(\"Unable to create mount point %s: %v\", mount[1], err)\n\t\t\t\tcontinue\n\t\t\t}\n\t\t\tcmdArgs := []string{mount[0], mount[1], \"-t\", mount[2]}\n\t\t\tif mount[3] != \"\" {\n\t\t\t\tcmdArgs = append(cmdArgs, \"-o\", mount[3])\n\t\t\t}\n\t\t\tcmd := exec.Command(\"mount\", cmdArgs...)\n\t\t\tcmd.Stdout = os.Stdout\n\t\t\tcmd.Stderr = os.Stderr\n\t\t\tif err := cmd.Run(); err != nil {\n\t\t\t\tlog.Errorf(\"Failed to mount %s: %v\", mount[1], err)\n\t\t\t}\n\t\t\tcontinue\n\t\t}\n\n\t\tdevice := util.ResolveDevice(mount[0])\n\n\t\tif mount[2] == \"swap\" {\n\t\t\tcmd := exec.Command(\"swapon\", device)\n\t\t\tcmd.Stdout = os.Stdout\n\t\t\tcmd.Stderr = os.Stderr\n\t\t\terr := cmd.Run()\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"Unable to swapon %s: %v\", device, err)\n\t\t\t}\n\t\t\tcontinue\n\t\t}\n\n\t\tif err := util.Mount(device, mount[1], mount[2], mount[3]); err != nil {\n\t\t\tlog.Errorf(\"Failed to mount %s: %v\", mount[1], err)\n\t\t}\n\t}\n\n\terr := util.RunCommandSequence(cfg.Runcmd)\n\tif err != nil {\n\t\tlog.Error(err)\n\t}\n}\n\nfunc WriteFiles(cfg *rancherConfig.CloudConfig, container string) {\n\tfor _, file := range cfg.WriteFiles {\n\t\tfileContainer := file.Container\n\t\tif fileContainer == \"\" {\n\t\t\tfileContainer = \"console\"\n\t\t}\n\t\tif fileContainer != container {\n\t\t\tcontinue\n\t\t}\n\n\t\tcontent, err := config.DecodeContent(file.File.Content, file.File.Encoding)\n\t\tif err != nil {\n\t\t\tcontinue\n\t\t}\n\n\t\tfile.File.Content = string(content)\n\t\tfile.File.Encoding = \"\"\n\n\t\tf := system.File{\n\t\t\tFile: file.File,\n\t\t}\n\t\tfullPath, err := system.WriteFile(&f, \"/\")\n\t\tif err != nil {\n\t\t\tlog.WithFields(log.Fields{\"err\": err, \"path\": fullPath}).Error(\"Error writing file\")\n\t\t\tcontinue\n\t\t}\n\t\tlog.Printf(\"Wrote file %s to filesystem\", fullPath)\n\t}\n}\n\nfunc applyPreConsole(cfg *rancherConfig.CloudConfig) {\n\tif cfg.Rancher.ResizeDevice != \"\" {\n\t\tif _, err := os.Stat(resizeStamp); os.IsNotExist(err) {\n\t\t\tif err := resizeDevice(cfg); err == nil {\n\t\t\t\tos.Create(resizeStamp)\n\t\t\t} else {\n\t\t\t\tlog.Errorf(\"Failed to resize %s: %s\", cfg.Rancher.ResizeDevice, err)\n\t\t\t}\n\t\t} else {\n\t\t\tlog.Infof(\"Skipped resizing %s because %s exists\", cfg.Rancher.ResizeDevice, resizeStamp)\n\t\t}\n\t}\n\n\tfor k, v := range cfg.Rancher.Sysctl {\n\t\telems := []string{\"/proc\", \"sys\"}\n\t\telems = append(elems, strings.Split(k, \".\")...)\n\t\tpath := path.Join(elems...)\n\t\tif err := ioutil.WriteFile(path, []byte(v), 0644); err != nil {\n\t\t\tlog.Errorf(\"Failed to set sysctl key %s: %s\", k, err)\n\t\t}\n\t}\n\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tfor _, restart := range cfg.Rancher.RestartServices {\n\t\tif err = client.ContainerRestart(context.Background(), restart, 10); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n}\n\nfunc resizeDevice(cfg *rancherConfig.CloudConfig) error {\n\tpartition := \"1\"\n\ttargetPartition := fmt.Sprintf(\"%s%s\", cfg.Rancher.ResizeDevice, partition)\n\n\tif strings.Contains(cfg.Rancher.ResizeDevice, \"mmcblk\") {\n\t\tpartition = \"2\"\n\t\ttargetPartition = fmt.Sprintf(\"%sp%s\", cfg.Rancher.ResizeDevice, partition)\n\t} else if strings.Contains(cfg.Rancher.ResizeDevice, \"nvme\") {\n\t\ttargetPartition = fmt.Sprintf(\"%sp%s\", cfg.Rancher.ResizeDevice, partition)\n\t}\n\n\tcmd := exec.Command(\"growpart\", cfg.Rancher.ResizeDevice, partition)\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\tcmd.Run()\n\n\tcmd = exec.Command(\"partprobe\", cfg.Rancher.ResizeDevice)\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\terr := cmd.Run()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcmd = exec.Command(\"resize2fs\", targetPartition)\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\terr = cmd.Run()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/cloudinitsave/cloudinitsave.go", "content": "// Copyright 2015 CoreOS, Inc.\n// Copyright 2015-2017 Rancher Labs, Inc.\n//\n// Licensed under the Apache License, Version 2.0 (the \"License\");\n// you may not use this file except in compliance with the License.\n// You may obtain a copy of the License at\n//\n// http://www.apache.org/licenses/LICENSE-2.0\n//\n// Unless required by applicable law or agreed to in writing, software\n// distributed under the License is distributed on an \"AS IS\" BASIS,\n// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n// See the License for the specific language governing permissions and\n// limitations under the License.\n\npackage cloudinitsave\n\nimport (\n\t\"bytes\"\n\t\"errors\"\n\t\"os\"\n\t\"path\"\n\t\"strings\"\n\t\"sync\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/cmd/control\"\n\t\"github.com/burmilla/os/cmd/network\"\n\trancherConfig \"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/config/cloudinit/config\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/configdrive\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/file\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/aliyun\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/azure\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/cloudstack\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/digitalocean\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/ec2\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/exoscale\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/gce\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/metadata/packet\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/proccmdline\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/proxmox\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/tftp\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/url\"\n\t\"github.com/burmilla/os/config/cloudinit/datasource/vmware\"\n\t\"github.com/burmilla/os/config/cloudinit/pkg\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/netconf\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\tyaml \"github.com/cloudfoundry-incubator/candiedyaml\"\n)\n\nconst (\n\tdatasourceInterval = 100 * time.Millisecond\n\tdatasourceMaxInterval = 30 * time.Second\n\tdatasourceTimeout = 5 * time.Minute\n)\n\nfunc Main() {\n\tlog.InitLogger()\n\tlog.Info(\"Running cloud-init-save\")\n\n\tif err := control.UdevSettle(); err != nil {\n\t\tlog.Errorf(\"Failed to run udev settle: %v\", err)\n\t}\n\n\tif err := saveCloudConfig(); err != nil {\n\t\tlog.Errorf(\"Failed to save cloud-config: %v\", err)\n\t}\n\n\t// exit wpa_supplicant\n\tnetconf.StopWpaSupplicant()\n\t// exit dhcpcd\n\tnetconf.StopDhcpcd()\n}\n\nfunc saveCloudConfig() error {\n\tlog.Infof(\"SaveCloudConfig\")\n\n\tcfg := rancherConfig.LoadConfig()\n\tlog.Debugf(\"init: SaveCloudConfig(pre ApplyNetworkConfig): %#v\", cfg.Rancher.Network)\n\tnetwork.ApplyNetworkConfig(cfg)\n\n\tlog.Infof(\"datasources that will be considered: %#v\", cfg.Rancher.CloudInit.Datasources)\n\tdss := getDatasources(cfg.Rancher.CloudInit.Datasources)\n\tif len(dss) == 0 {\n\t\tlog.Errorf(\"currentDatasource - none found\")\n\t\treturn nil\n\t}\n\n\tfoundDs := selectDatasource(dss)\n\tlog.Infof(\"Cloud-init datasource that was used: %s\", foundDs)\n\n\t// Apply any newly detected network config.\n\tcfg = rancherConfig.LoadConfig()\n\tlog.Debugf(\"init: SaveCloudConfig(post ApplyNetworkConfig): %#v\", cfg.Rancher.Network)\n\tnetwork.ApplyNetworkConfig(cfg)\n\n\treturn nil\n}\n\nfunc saveFiles(cloudConfigBytes, scriptBytes []byte, metadata datasource.Metadata) error {\n\tos.MkdirAll(rancherConfig.CloudConfigDir, os.ModeDir|0600)\n\n\tif len(scriptBytes) > 0 {\n\t\tlog.Infof(\"Writing to %s\", rancherConfig.CloudConfigScriptFile)\n\t\tif err := util.WriteFileAtomic(rancherConfig.CloudConfigScriptFile, scriptBytes, 500); err != nil {\n\t\t\tlog.Errorf(\"Error while writing file %s: %v\", rancherConfig.CloudConfigScriptFile, err)\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif len(cloudConfigBytes) > 0 {\n\t\tif err := util.WriteFileAtomic(rancherConfig.CloudConfigBootFile, cloudConfigBytes, 400); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tlog.Infof(\"Wrote to %s\", rancherConfig.CloudConfigBootFile)\n\t}\n\n\tmetaDataBytes, err := yaml.Marshal(metadata)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif err = util.WriteFileAtomic(rancherConfig.MetaDataFile, metaDataBytes, 400); err != nil {\n\t\treturn err\n\t}\n\tlog.Infof(\"Wrote to %s\", rancherConfig.MetaDataFile)\n\n\t// if we write the empty meta yml, the merge fails.\n\t// TODO: the problem is that a partially filled one will still have merge issues, so that needs fixing - presumably by making merge more clever, and making more fields optional\n\temptyMeta, err := yaml.Marshal(datasource.Metadata{})\n\tif err != nil {\n\t\treturn err\n\t}\n\tif bytes.Compare(metaDataBytes, emptyMeta) == 0 {\n\t\tlog.Infof(\"not writing %s: its all defaults.\", rancherConfig.CloudConfigNetworkFile)\n\t\treturn nil\n\t}\n\n\ttype nonRancherCfg struct {\n\t\tNetwork netconf.NetworkConfig `yaml:\"network,omitempty\"`\n\t}\n\ttype nonCfg struct {\n\t\tRancher nonRancherCfg `yaml:\"rancher,omitempty\"`\n\t}\n\t// write the network.yml file from metadata\n\tcc := nonCfg{\n\t\tRancher: nonRancherCfg{\n\t\t\tNetwork: metadata.NetworkConfig,\n\t\t},\n\t}\n\n\tif err := os.MkdirAll(path.Dir(rancherConfig.CloudConfigNetworkFile), 0700); err != nil {\n\t\tlog.Errorf(\"Failed to create directory for file %s: %v\", rancherConfig.CloudConfigNetworkFile, err)\n\t}\n\n\tif err := rancherConfig.WriteToFile(cc, rancherConfig.CloudConfigNetworkFile); err != nil {\n\t\tlog.Errorf(\"Failed to save config file %s: %v\", rancherConfig.CloudConfigNetworkFile, err)\n\t}\n\tlog.Infof(\"Wrote to %s\", rancherConfig.CloudConfigNetworkFile)\n\n\treturn nil\n}\n\nfunc fetchAndSave(ds datasource.Datasource) error {\n\tvar metadata datasource.Metadata\n\n\tlog.Infof(\"Fetching user-data from datasource %s\", ds)\n\tuserDataBytes, err := ds.FetchUserdata()\n\tif err != nil {\n\t\tlog.Errorf(\"Failed fetching user-data from datasource: %v\", err)\n\t\treturn err\n\t}\n\tuserDataBytes, err = decompressIfGzip(userDataBytes)\n\tif err != nil {\n\t\tlog.Errorf(\"Failed decompressing user-data from datasource: %v\", err)\n\t\treturn err\n\t}\n\tlog.Infof(\"Fetching meta-data from datasource of type %v\", ds.Type())\n\tmetadata, err = ds.FetchMetadata()\n\tif err != nil {\n\t\tlog.Errorf(\"Failed fetching meta-data from datasource: %v\", err)\n\t\treturn err\n\t}\n\n\tuserData := string(userDataBytes)\n\tscriptBytes := []byte{}\n\n\tif config.IsScript(userData) {\n\t\tscriptBytes = userDataBytes\n\t\tuserDataBytes = []byte{}\n\t} else if isCompose(userData) {\n\t\tif userDataBytes, err = composeToCloudConfig(userDataBytes); err != nil {\n\t\t\tlog.Errorf(\"Failed to convert compose to cloud-config syntax: %v\", err)\n\t\t\treturn err\n\t\t}\n\t} else if config.IsCloudConfig(userData) {\n\t\tif _, err := rancherConfig.ReadConfig(userDataBytes, false); err != nil {\n\t\t\tlog.WithFields(log.Fields{\"cloud-config\": userData, \"err\": err}).Warn(\"Failed to parse cloud-config, not saving.\")\n\t\t\tuserDataBytes = []byte{}\n\t\t}\n\t} else {\n\t\tlog.Errorf(\"Unrecognized user-data\\n(%s)\", userData)\n\t\tuserDataBytes = []byte{}\n\t}\n\n\tif _, err := rancherConfig.ReadConfig(userDataBytes, false); err != nil {\n\t\tlog.WithFields(log.Fields{\"cloud-config\": userData, \"err\": err}).Warn(\"Failed to parse cloud-config\")\n\t\treturn errors.New(\"Failed to parse cloud-config\")\n\t}\n\n\treturn saveFiles(userDataBytes, scriptBytes, metadata)\n}\n\n// getDatasources creates a slice of possible Datasources for cloudinit based\n// on the different source command-line flags.\nfunc getDatasources(datasources []string) []datasource.Datasource {\n\tdss := make([]datasource.Datasource, 0, 5)\n\n\tfor _, ds := range datasources {\n\t\tparts := strings.SplitN(ds, \":\", 2)\n\n\t\troot := \"\"\n\t\tif len(parts) > 1 {\n\t\t\troot = parts[1]\n\t\t}\n\n\t\tswitch parts[0] {\n\t\tcase \"*\":\n\t\t\tdss = append(dss, getDatasources([]string{\"configdrive\", \"vmware\", \"ec2\", \"digitalocean\", \"packet\", \"gce\", \"cloudstack\", \"exoscale\", \"proxmox\"})...)\n\t\tcase \"proxmox\":\n\t\t\tif root == \"\" {\n\t\t\t\troot = \"/media/pve-config\"\n\t\t\t}\n\t\t\tdss = append(dss, proxmox.NewDataSource(root))\n\t\tcase \"exoscale\":\n\t\t\tdss = append(dss, exoscale.NewDatasource(root))\n\t\tcase \"cloudstack\":\n\t\t\tfor _, source := range cloudstack.NewDatasource(root) {\n\t\t\t\tdss = append(dss, source)\n\t\t\t}\n\t\tcase \"ec2\":\n\t\t\tdss = append(dss, ec2.NewDatasource(root))\n\t\tcase \"file\":\n\t\t\tif root != \"\" {\n\t\t\t\tdss = append(dss, file.NewDatasource(root))\n\t\t\t}\n\t\tcase \"tftp\":\n\t\t\tdss = append(dss, tftp.NewDatasource(root))\n\t\tcase \"url\":\n\t\t\tif root != \"\" {\n\t\t\t\tdss = append(dss, url.NewDatasource(root))\n\t\t\t}\n\t\tcase \"cmdline\":\n\t\t\tif len(parts) == 1 {\n\t\t\t\tdss = append(dss, proccmdline.NewDatasource())\n\t\t\t}\n\t\tcase \"configdrive\":\n\t\t\tif root == \"\" {\n\t\t\t\troot = \"/media/config-2\"\n\t\t\t}\n\t\t\tdss = append(dss, configdrive.NewDatasource(root))\n\t\tcase \"digitalocean\":\n\t\t\t// TODO: should we enableDoLinkLocal() - to avoid the need for the other kernel/oem options?\n\t\t\tdss = append(dss, digitalocean.NewDatasource(root))\n\t\tcase \"gce\":\n\t\t\tdss = append(dss, gce.NewDatasource(root))\n\t\tcase \"packet\":\n\t\t\tdss = append(dss, packet.NewDatasource(root))\n\t\tcase \"vmware\":\n\t\t\t// made vmware datasource dependent on detecting vmware independently, as it crashes things otherwise\n\t\t\tv := vmware.NewDatasource(root)\n\t\t\tif v != nil {\n\t\t\t\tdss = append(dss, v)\n\t\t\t}\n\t\tcase \"aliyun\":\n\t\t\tdss = append(dss, aliyun.NewDatasource(root))\n\t\tcase \"azure\":\n\t\t\tdss = append(dss, azure.NewDatasource(root))\n\t\t}\n\t}\n\n\treturn dss\n}\n\nfunc enableDoLinkLocal() {\n\tcfg := rancherConfig.LoadConfig()\n\tdhcpTimeout := cfg.Rancher.Defaults.Network.DHCPTimeout\n\tif cfg.Rancher.Network.DHCPTimeout > 0 {\n\t\tdhcpTimeout = cfg.Rancher.Network.DHCPTimeout\n\t}\n\t_, err := netconf.ApplyNetworkConfigs(&netconf.NetworkConfig{\n\t\tInterfaces: map[string]netconf.InterfaceConfig{\n\t\t\t\"eth0\": {\n\t\t\t\tIPV4LL: true,\n\t\t\t},\n\t\t},\n\t\tDHCPTimeout: dhcpTimeout,\n\t}, false, false)\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to apply link local on eth0: %v\", err)\n\t}\n}\n\n// selectDatasource attempts to choose a valid Datasource to use based on its\n// current availability. The first Datasource to report to be available is\n// returned. Datasources will be retried if possible if they are not\n// immediately available. If all Datasources are permanently unavailable or\n// datasourceTimeout is reached before one becomes available, nil is returned.\nfunc selectDatasource(sources []datasource.Datasource) datasource.Datasource {\n\tds := make(chan datasource.Datasource)\n\tstop := make(chan struct{})\n\tvar wg sync.WaitGroup\n\n\tfor _, s := range sources {\n\t\twg.Add(1)\n\t\tgo func(s datasource.Datasource) {\n\t\t\tdefer wg.Done()\n\n\t\t\tduration := datasourceInterval\n\t\t\tfor {\n\t\t\t\tlog.Infof(\"cloud-init: Checking availability of %q\", s.Type())\n\t\t\t\tif s.IsAvailable() {\n\t\t\t\t\tlog.Infof(\"cloud-init: Datasource available: %s\", s)\n\t\t\t\t\tds <- s\n\t\t\t\t\treturn\n\t\t\t\t}\n\t\t\t\tif !s.AvailabilityChanges() {\n\t\t\t\t\tlog.Infof(\"cloud-init: Datasource unavailable, skipping: %s\", s)\n\t\t\t\t\treturn\n\t\t\t\t}\n\t\t\t\tlog.Errorf(\"cloud-init: Datasource not ready, will retry: %s\", s)\n\t\t\t\tselect {\n\t\t\t\tcase <-stop:\n\t\t\t\t\treturn\n\t\t\t\tcase <-time.After(duration):\n\t\t\t\t\tduration = pkg.ExpBackoff(duration, datasourceMaxInterval)\n\t\t\t\t}\n\t\t\t}\n\t\t}(s)\n\t}\n\n\tdone := make(chan struct{})\n\tgo func() {\n\t\twg.Wait()\n\t\tclose(done)\n\t}()\n\n\tvar s datasource.Datasource\n\tselect {\n\tcase s = <-ds:\n\t\terr := fetchAndSave(s)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"Error fetching cloud-init datasource(%s): %s\", s, err)\n\t\t}\n\tcase <-done:\n\tcase <-time.After(datasourceTimeout):\n\t}\n\n\tclose(stop)\n\treturn s\n}\n\nfunc isCompose(content string) bool {\n\treturn strings.HasPrefix(content, \"#compose\\n\")\n}\n\nfunc composeToCloudConfig(bytes []byte) ([]byte, error) {\n\tcompose := make(map[interface{}]interface{})\n\terr := yaml.Unmarshal(bytes, &compose)\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\treturn yaml.Marshal(map[interface{}]interface{}{\n\t\t\"rancher\": map[interface{}]interface{}{\n\t\t\t\"services\": compose,\n\t\t},\n\t})\n}\n\nconst gzipMagicBytes = \"\\x1f\\x8b\"\n\nfunc decompressIfGzip(userdataBytes []byte) ([]byte, error) {\n\tif !bytes.HasPrefix(userdataBytes, []byte(gzipMagicBytes)) {\n\t\treturn userdataBytes, nil\n\t}\n\n\treturn config.DecompressGzip(userdataBytes)\n}\n" }, { "path": "cmd/control/autologin.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nfunc AutologinMain() {\n\tlog.InitLogger()\n\tapp := cli.NewApp()\n\n\tapp.Name = os.Args[0]\n\tapp.Usage = \"autologin console\"\n\tapp.Version = config.Version\n\tapp.Author = \"Project Burmilla\\n\\tRancher Labs, Inc.\"\n\tapp.Email = \"burmilla@localhost.local\"\n\tapp.EnableBashCompletion = true\n\tapp.Action = autologinAction\n\tapp.HideHelp = true\n\tapp.Run(os.Args)\n}\n\nfunc autologinAction(c *cli.Context) error {\n\tcmd := exec.Command(\"/bin/stty\", \"sane\")\n\tcmd.Stderr = os.Stderr\n\tcmd.Stdout = os.Stdout\n\tcmd.Stdin = os.Stdin\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tusertty := \"\"\n\tuser := \"root\"\n\tif c.NArg() > 0 {\n\t\tusertty = c.Args().Get(0)\n\t\ts := strings.SplitN(usertty, \":\", 2)\n\t\tuser = s[0]\n\t}\n\n\tmode := filepath.Base(os.Args[0])\n\tconsole := CurrentConsole()\n\n\tcfg := config.LoadConfig()\n\n\tloginBin := \"\"\n\targs := []string{}\n\tif console == \"centos\" || console == \"fedora\" ||\n\t\tmode == \"recovery\" {\n\t\t// For some reason, centos and fedora ttyS0 and tty1 don't work with `login -f rancher`\n\t\t// until I make time to read their source, lets just give us a way to get work done\n\t\tloginBin = \"bash\"\n\t\targs = append(args, \"--login\")\n\t\tif mode == \"recovery\" {\n\t\t\tos.Setenv(\"PROMPT_COMMAND\", `echo \"[`+fmt.Sprintf(\"Recovery console %s@%s:${PWD}\", user, cfg.Hostname)+`]\"`)\n\t\t}\n\t} else {\n\t\tloginBin = \"login\"\n\t\targs = append(args, \"-f\", user)\n\t\t// TODO: add a PROMPT_COMMAND if we haven't switch-rooted\n\t}\n\n\tloginBinPath, err := exec.LookPath(loginBin)\n\tif err != nil {\n\t\tfmt.Printf(\"error finding %s in path: %s\", cmd.Args[0], err)\n\t\treturn err\n\t}\n\tos.Setenv(\"TERM\", \"linux\")\n\n\t// Causes all sorts of issues\n\t//return syscall.Exec(loginBinPath, args, os.Environ())\n\tcmd = exec.Command(loginBinPath, args...)\n\tcmd.Env = os.Environ()\n\n\tcmd.Stderr = os.Stderr\n\tcmd.Stdout = os.Stdout\n\tcmd.Stdin = os.Stdin\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"\\nError starting %s: %s\", cmd.Args[0], err)\n\t}\n\treturn nil\n}\n" }, { "path": "cmd/control/bootstrap.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\t\"strings\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n)\n\nfunc BootstrapMain() {\n\tlog.InitLogger()\n\n\tlog.Debugf(\"bootstrapAction\")\n\tif err := UdevSettle(); err != nil {\n\t\tlog.Errorf(\"Failed to run udev settle: %v\", err)\n\t}\n\n\tlog.Debugf(\"bootstrapAction: loadingConfig\")\n\tcfg := config.LoadConfig()\n\n\tlog.Debugf(\"bootstrapAction: Rngd(%v)\", cfg.Rancher.State.Rngd)\n\tif cfg.Rancher.State.Rngd {\n\t\tif err := runRngd(); err != nil {\n\t\t\tlog.Errorf(\"Failed to run rngd: %v\", err)\n\t\t}\n\t}\n\n\tlog.Debugf(\"bootstrapAction: MdadmScan(%v)\", cfg.Rancher.State.MdadmScan)\n\tif cfg.Rancher.State.MdadmScan {\n\t\tif err := mdadmScan(); err != nil {\n\t\t\tlog.Errorf(\"Failed to run mdadm scan: %v\", err)\n\t\t}\n\t}\n\n\tlog.Debugf(\"bootstrapAction: cryptsetup(%v)\", cfg.Rancher.State.Cryptsetup)\n\tif cfg.Rancher.State.Cryptsetup {\n\t\tif err := cryptsetup(); err != nil {\n\t\t\tlog.Errorf(\"Failed to run cryptsetup: %v\", err)\n\t\t}\n\t}\n\n\tlog.Debugf(\"bootstrapAction: LvmScan(%v)\", cfg.Rancher.State.LvmScan)\n\tif cfg.Rancher.State.LvmScan {\n\t\tif err := vgchange(); err != nil {\n\t\t\tlog.Errorf(\"Failed to run vgchange: %v\", err)\n\t\t}\n\t}\n\n\tstateScript := cfg.Rancher.State.Script\n\tlog.Debugf(\"bootstrapAction: stateScript(%v)\", stateScript)\n\tif stateScript != \"\" {\n\t\tif err := runStateScript(stateScript); err != nil {\n\t\t\tlog.Errorf(\"Failed to run state script: %v\", err)\n\t\t}\n\t}\n\n\tlog.Debugf(\"bootstrapAction: RunCommandSequence(%v)\", cfg.Bootcmd)\n\terr := util.RunCommandSequence(cfg.Bootcmd)\n\tif err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif cfg.Rancher.State.Dev != \"\" && cfg.Rancher.State.Wait {\n\t\twaitForRoot(cfg)\n\t}\n\n\tif len(cfg.Rancher.State.Autoformat) > 0 {\n\t\tlog.Infof(\"bootstrap container: Autoformat(%v) as %s\", cfg.Rancher.State.Autoformat, \"ext4\")\n\t\tif err := autoformat(cfg.Rancher.State.Autoformat); err != nil {\n\t\t\tlog.Errorf(\"Failed to run autoformat: %v\", err)\n\t\t}\n\t}\n\n\tlog.Debugf(\"bootstrapAction: udev settle2\")\n\tif err := UdevSettle(); err != nil {\n\t\tlog.Errorf(\"Failed to run udev settle: %v\", err)\n\t}\n}\n\nfunc mdadmScan() error {\n\tcmd := exec.Command(\"mdadm\", \"--assemble\", \"--scan\")\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\treturn cmd.Run()\n}\n\nfunc vgchange() error {\n\tcmd := exec.Command(\"vgchange\", \"--activate\", \"ay\")\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\treturn cmd.Run()\n}\n\nfunc cryptsetup() error {\n\tdevices, err := util.BlkidType(\"crypto_LUKS\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor _, cryptdevice := range devices {\n\t\tfdRead, err := os.Open(\"/dev/console\")\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tdefer fdRead.Close()\n\n\t\tfdWrite, err := os.OpenFile(\"/dev/console\", os.O_WRONLY|os.O_APPEND, 0)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tdefer fdWrite.Close()\n\n\t\tcmd := exec.Command(\"cryptsetup\", \"luksOpen\", cryptdevice, fmt.Sprintf(\"luks-%s\", filepath.Base(cryptdevice)))\n\t\tcmd.Stdout = fdWrite\n\t\tcmd.Stderr = fdWrite\n\t\tcmd.Stdin = fdRead\n\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Errorf(\"Failed to run cryptsetup for %s: %v\", cryptdevice, err)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc runRngd() error {\n\t// use /dev/urandom as random number input for rngd\n\t// this is a really bad idea\n\t// since I am simple filling the kernel entropy pool with entropy coming from the kernel itself!\n\t// but this does not need to consider the user's hw rngd drivers.\n\tcmd := exec.Command(\"rngd\", \"-r\", \"/dev/urandom\", \"-q\")\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\treturn cmd.Run()\n}\n\nfunc runStateScript(script string) error {\n\tf, err := ioutil.TempFile(\"\", \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\tif _, err := f.WriteString(script); err != nil {\n\t\treturn err\n\t}\n\tif err := f.Chmod(os.ModePerm); err != nil {\n\t\treturn err\n\t}\n\tif err := f.Close(); err != nil {\n\t\treturn err\n\t}\n\treturn util.RunScript(f.Name())\n}\n\nfunc waitForRoot(cfg *config.CloudConfig) {\n\tvar dev string\n\tfor i := 0; i < 30; i++ {\n\t\tdev = util.ResolveDevice(cfg.Rancher.State.Dev)\n\t\tif dev != \"\" {\n\t\t\tbreak\n\t\t}\n\t\ttime.Sleep(time.Millisecond * 1000)\n\t}\n\tif dev == \"\" {\n\t\treturn\n\t}\n\tfor i := 0; i < 30; i++ {\n\t\tif _, err := os.Stat(dev); err == nil {\n\t\t\tbreak\n\t\t}\n\t\ttime.Sleep(time.Millisecond * 1000)\n\t}\n}\n\nfunc autoformat(autoformatDevices []string) error {\n\tcmd := exec.Command(\"/usr/sbin/auto-format.sh\")\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\tcmd.Env = []string{\n\t\t\"AUTOFORMAT=\" + strings.Join(autoformatDevices, \" \"),\n\t}\n\treturn cmd.Run()\n}\n" }, { "path": "cmd/control/cli.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"os\"\n\n\t\"github.com/burmilla/os/cmd/control/service\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nfunc Main() {\n\tlog.InitLogger()\n\tcli.VersionPrinter = func(c *cli.Context) {\n\t\tcfg := config.LoadConfig()\n\t\trunningName := cfg.Rancher.Upgrade.Image + \":\" + config.Version\n\t\tfmt.Fprintf(c.App.Writer, \"version %s from os image %s\\n\", c.App.Version, runningName)\n\t}\n\tapp := cli.NewApp()\n\n\tapp.Name = os.Args[0]\n\tapp.Usage = fmt.Sprintf(\"Control and configure BurmillaOS\\nbuilt: %s\", config.BuildDate)\n\tapp.Version = config.Version\n\tapp.Author = \"Project Burmilla\\n\\tRancher Labs, Inc.\"\n\tapp.EnableBashCompletion = true\n\tapp.Before = func(c *cli.Context) error {\n\t\tif os.Geteuid() != 0 {\n\t\t\tlog.Fatalf(\"%s: Need to be root\", os.Args[0])\n\t\t}\n\t\treturn nil\n\t}\n\n\tapp.Commands = []cli.Command{\n\t\t{\n\t\t\tName: \"config\",\n\t\t\tShortName: \"c\",\n\t\t\tUsage: \"configure settings\",\n\t\t\tHideHelp: true,\n\t\t\tSubcommands: configSubcommands(),\n\t\t},\n\t\t{\n\t\t\tName: \"console\",\n\t\t\tUsage: \"manage which console container is used\",\n\t\t\tHideHelp: true,\n\t\t\tSubcommands: consoleSubcommands(),\n\t\t},\n\t\t{\n\t\t\tName: \"console-init\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: consoleInitAction,\n\t\t},\n\t\t{\n\t\t\tName: \"dev\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: devAction,\n\t\t},\n\t\t{\n\t\t\tName: \"docker-init\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: dockerInitAction,\n\t\t},\n\t\t{\n\t\t\tName: \"engine\",\n\t\t\tUsage: \"manage which Docker engine is used\",\n\t\t\tHideHelp: true,\n\t\t\tSubcommands: engineSubcommands(),\n\t\t},\n\t\t{\n\t\t\tName: \"entrypoint\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: entrypointAction,\n\t\t},\n\t\t{\n\t\t\tName: \"env\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: envAction,\n\t\t},\n\t\tservice.Commands(),\n\t\t{\n\t\t\tName: \"os\",\n\t\t\tUsage: \"operating system upgrade/downgrade\",\n\t\t\tHideHelp: true,\n\t\t\tSubcommands: osSubcommands(),\n\t\t},\n\t\t{\n\t\t\tName: \"preload-images\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: preloadImagesAction,\n\t\t},\n\t\t{\n\t\t\tName: \"recovery-init\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: recoveryInitAction,\n\t\t},\n\t\t{\n\t\t\tName: \"switch-console\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: switchConsoleAction,\n\t\t},\n\t\t{\n\t\t\tName: \"tls\",\n\t\t\tUsage: \"setup tls configuration\",\n\t\t\tHideHelp: true,\n\t\t\tSubcommands: tlsConfCommands(),\n\t\t},\n\t\t{\n\t\t\tName: \"udev-settle\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: udevSettleAction,\n\t\t},\n\t\t{\n\t\t\tName: \"user-docker\",\n\t\t\tHidden: true,\n\t\t\tHideHelp: true,\n\t\t\tSkipFlagParsing: true,\n\t\t\tAction: userDockerAction,\n\t\t},\n\t\tinstallCommand,\n\t}\n\n\tapp.Run(os.Args)\n}\n" }, { "path": "cmd/control/config.go", "content": "package control\n\nimport (\n\t\"bufio\"\n\t\"bytes\"\n\t\"fmt\"\n\t\"io\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"sort\"\n\t\"strings\"\n\t\"text/template\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\tyaml \"github.com/cloudfoundry-incubator/candiedyaml\"\n\t\"github.com/codegangsta/cli\"\n\t\"github.com/pkg/errors\"\n)\n\nfunc configSubcommands() []cli.Command {\n\treturn []cli.Command{\n\t\t{\n\t\t\tName: \"get\",\n\t\t\tUsage: \"get value\",\n\t\t\tAction: configGet,\n\t\t},\n\t\t{\n\t\t\tName: \"set\",\n\t\t\tUsage: \"set a value\",\n\t\t\tAction: configSet,\n\t\t},\n\t\t{\n\t\t\tName: \"images\",\n\t\t\tUsage: \"List Docker images for a configuration from a file\",\n\t\t\tAction: runImages,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"input, i\",\n\t\t\t\t\tUsage: \"File from which to read config\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"generate\",\n\t\t\tUsage: \"Generate a configuration file from a template\",\n\t\t\tAction: runGenerate,\n\t\t\tHideHelp: true,\n\t\t},\n\t\t{\n\t\t\tName: \"export\",\n\t\t\tUsage: \"export configuration\",\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"output, o\",\n\t\t\t\t\tUsage: \"File to which to save\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"private, p\",\n\t\t\t\t\tUsage: \"Include the generated private keys\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"full, f\",\n\t\t\t\t\tUsage: \"Export full configuration, including internal and default settings\",\n\t\t\t\t},\n\t\t\t},\n\t\t\tAction: export,\n\t\t},\n\t\t{\n\t\t\tName: \"merge\",\n\t\t\tUsage: \"merge configuration from stdin\",\n\t\t\tAction: merge,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"input, i\",\n\t\t\t\t\tUsage: \"File from which to read\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"syslinux\",\n\t\t\tUsage: \"edit Syslinux boot global.cfg\",\n\t\t\tAction: editSyslinux,\n\t\t},\n\t\t{\n\t\t\tName: \"validate\",\n\t\t\tUsage: \"validate configuration from stdin\",\n\t\t\tAction: validate,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"input, i\",\n\t\t\t\t\tUsage: \"File from which to read\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc imagesFromConfig(cfg *config.CloudConfig) []string {\n\timagesMap := map[string]int{}\n\n\tfor _, service := range cfg.Rancher.BootstrapContainers {\n\t\timagesMap[service.Image] = 1\n\t}\n\tfor _, service := range cfg.Rancher.Services {\n\t\timagesMap[service.Image] = 1\n\t}\n\n\timages := make([]string, len(imagesMap))\n\ti := 0\n\tfor image := range imagesMap {\n\t\timages[i] = image\n\t\ti++\n\t}\n\tsort.Strings(images)\n\treturn images\n}\n\nfunc runImages(c *cli.Context) error {\n\tconfigFile := c.String(\"input\")\n\tcfg, err := config.ReadConfig(nil, false, configFile)\n\tif err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err, \"file\": configFile}).Fatalf(\"Could not read config from file\")\n\t}\n\timages := imagesFromConfig(cfg)\n\tfmt.Println(strings.Join(images, \" \"))\n\treturn nil\n}\n\nfunc runGenerate(c *cli.Context) error {\n\tif err := genTpl(os.Stdin, os.Stdout); err != nil {\n\t\tlog.Fatalf(\"Failed to generate config, err: '%s'\", err)\n\t}\n\treturn nil\n}\n\nfunc genTpl(in io.Reader, out io.Writer) error {\n\tbytes, err := ioutil.ReadAll(in)\n\tif err != nil {\n\t\tlog.Fatal(\"Could not read from stdin\")\n\t}\n\ttpl := template.Must(template.New(\"osconfig\").Parse(string(bytes)))\n\treturn tpl.Execute(out, env2map(os.Environ()))\n}\n\nfunc env2map(env []string) map[string]string {\n\tm := make(map[string]string, len(env))\n\tfor _, s := range env {\n\t\td := strings.Split(s, \"=\")\n\t\tm[d[0]] = d[1]\n\t}\n\treturn m\n}\n\nfunc editSyslinux(c *cli.Context) error {\n\t// check whether is Raspberry Pi or not\n\tbytes, err := ioutil.ReadFile(\"/proc/device-tree/model\")\n\tif err == nil && strings.Contains(strings.ToLower(string(bytes)), \"raspberry\") {\n\t\tbuf := bufio.NewWriter(os.Stdout)\n\t\tfmt.Fprintln(buf, \"raspberry pi can not use this command\")\n\t\tbuf.Flush()\n\t\treturn errors.New(\"raspberry pi can not use this command\")\n\t}\n\n\tif isExist := checkGlobalCfg(); !isExist {\n\t\tbuf := bufio.NewWriter(os.Stdout)\n\t\tfmt.Fprintln(buf, \"global.cfg can not be found\")\n\t\tbuf.Flush()\n\t\treturn errors.New(\"global.cfg can not be found\")\n\t}\n\n\tcmd := exec.Command(\"system-docker\", \"run\", \"--rm\", \"-it\",\n\t\t\"-v\", \"/:/host\",\n\t\t\"-w\", \"/host\",\n\t\t\"--entrypoint=nano\",\n\t\t\"burmilla/os-console:\"+config.Version,\n\t\t\"boot/global.cfg\")\n\tcmd.Stdout, cmd.Stderr, cmd.Stdin = os.Stdout, os.Stderr, os.Stdin\n\treturn cmd.Run()\n}\n\nfunc configSet(c *cli.Context) error {\n\tif c.NArg() < 2 {\n\t\treturn nil\n\t}\n\n\tkey := c.Args().Get(0)\n\tvalue := c.Args().Get(1)\n\tif key == \"\" {\n\t\treturn nil\n\t}\n\n\terr := config.Set(key, value)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\treturn nil\n}\n\nfunc configGet(c *cli.Context) error {\n\targ := c.Args().Get(0)\n\tif arg == \"\" {\n\t\treturn nil\n\t}\n\n\tval, err := config.Get(arg)\n\tif err != nil {\n\t\tlog.WithFields(log.Fields{\"key\": arg, \"val\": val, \"err\": err}).Fatal(\"config get: failed to retrieve value\")\n\t}\n\n\tprintYaml := false\n\tswitch val.(type) {\n\tcase []interface{}:\n\t\tprintYaml = true\n\tcase map[interface{}]interface{}:\n\t\tprintYaml = true\n\t}\n\n\tif printYaml {\n\t\tbytes, err := yaml.Marshal(val)\n\t\tif err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t\tfmt.Println(string(bytes))\n\t} else {\n\t\tfmt.Println(val)\n\t}\n\n\treturn nil\n}\n\nfunc merge(c *cli.Context) error {\n\tbytes, err := inputBytes(c)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tif err = config.Merge(bytes); err != nil {\n\t\tlog.Error(err)\n\t\tvalidationErrors, err := config.ValidateBytes(bytes)\n\t\tif err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t\tfor _, validationError := range validationErrors.Errors() {\n\t\t\tlog.Error(validationError)\n\t\t}\n\t\tlog.Fatal(\"EXITING: Failed to parse configuration\")\n\t}\n\n\treturn nil\n}\n\nfunc export(c *cli.Context) error {\n\tcontent, err := config.Export(c.Bool(\"private\"), c.Bool(\"full\"))\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\toutput := c.String(\"output\")\n\tif output == \"\" {\n\t\tfmt.Println(content)\n\t} else {\n\t\terr := util.WriteFileAtomic(output, []byte(content), 0400)\n\t\tif err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc validate(c *cli.Context) error {\n\tbytes, err := inputBytes(c)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\tvalidationErrors, err := config.ValidateBytes(bytes)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\tfor _, validationError := range validationErrors.Errors() {\n\t\tlog.Error(validationError)\n\t}\n\treturn nil\n}\n\nfunc inputBytes(c *cli.Context) ([]byte, error) {\n\tinput := os.Stdin\n\tinputFile := c.String(\"input\")\n\tif inputFile != \"\" {\n\t\tvar err error\n\t\tinput, err = os.Open(inputFile)\n\t\tif err != nil {\n\t\t\treturn nil, err\n\t\t}\n\t\tdefer input.Close()\n\t}\n\tcontent, err := ioutil.ReadAll(input)\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\tif bytes.Contains(content, []byte{13, 10}) {\n\t\treturn nil, errors.New(\"file format shouldn't contain CRLF characters\")\n\t}\n\treturn content, nil\n}\n" }, { "path": "cmd/control/config_test.go", "content": "package control\n\nimport (\n\t\"bytes\"\n\t\"os\"\n\t\"strings\"\n\t\"testing\"\n\n\t\"github.com/stretchr/testify/require\"\n)\n\nfunc TestGenTpl(t *testing.T) {\n\tassert := require.New(t)\n\ttpl := `\n services:\n {{if eq \"amd64\" .ARCH -}}\n acpid:\n image: burmilla/os-acpid:0.x.x\n labels:\n io.rancher.os.scope: system\n net: host\n uts: host\n privileged: true\n volumes_from:\n - command-volumes\n - system-volumes\n {{end -}}\n all-volumes:`\n\n\tfor _, tc := range []struct {\n\t\tarch string\n\t\texpected string\n\t}{\n\t\t{\"amd64\", `\n services:\n acpid:\n image: burmilla/os-acpid:0.x.x\n labels:\n io.rancher.os.scope: system\n net: host\n uts: host\n privileged: true\n volumes_from:\n - command-volumes\n - system-volumes\n all-volumes:`},\n\t\t{\"arm\", `\n services:\n all-volumes:`},\n\t} {\n\t\tout := &bytes.Buffer{}\n\t\tos.Setenv(\"ARCH\", tc.arch)\n\t\tgenTpl(strings.NewReader(tpl), out)\n\t\tassert.Equal(tc.expected, out.String(), tc.arch)\n\t}\n}\n" }, { "path": "cmd/control/console.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"sort\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/cmd/control/service\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\t\"github.com/burmilla/os/pkg/util/network\"\n\n\t\"github.com/codegangsta/cli\"\n\t\"github.com/docker/docker/reference\"\n\tcomposeConfig \"github.com/docker/libcompose/config\"\n\t\"github.com/docker/libcompose/project/options\"\n\t\"golang.org/x/net/context\"\n)\n\nfunc consoleSubcommands() []cli.Command {\n\treturn []cli.Command{\n\t\t{\n\t\t\tName: \"switch\",\n\t\t\tUsage: \"switch console without a reboot\",\n\t\t\tAction: consoleSwitch,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"force, f\",\n\t\t\t\t\tUsage: \"do not prompt for input\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"no-pull\",\n\t\t\t\t\tUsage: \"don't pull console image\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"enable\",\n\t\t\tUsage: \"set console to be switched on next reboot\",\n\t\t\tAction: consoleEnable,\n\t\t},\n\t\t{\n\t\t\tName: \"list\",\n\t\t\tUsage: \"list available consoles\",\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"update, u\",\n\t\t\t\t\tUsage: \"update console cache\",\n\t\t\t\t},\n\t\t\t},\n\t\t\tAction: consoleList,\n\t\t},\n\t}\n}\n\nfunc consoleSwitch(c *cli.Context) error {\n\tif len(c.Args()) != 1 {\n\t\tlog.Fatal(\"Must specify exactly one console to switch to\")\n\t}\n\tnewConsole := c.Args()[0]\n\n\tcfg := config.LoadConfig()\n\tvalidateConsole(newConsole, cfg)\n\tif newConsole == CurrentConsole() {\n\t\tlog.Warnf(\"Console is already set to %s\", newConsole)\n\t}\n\n\tif !c.Bool(\"force\") {\n\t\tfmt.Println(`Switching consoles will\n1. destroy the current console container\n2. log you out\n3. restart Docker`)\n\t\tif !yes(\"Continue\") {\n\t\t\treturn nil\n\t\t}\n\t}\n\n\tif !c.Bool(\"no-pull\") && newConsole != \"default\" {\n\t\tif err := compose.StageServices(cfg, newConsole); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tservice, err := compose.CreateService(nil, \"switch-console\", &composeConfig.ServiceConfigV1{\n\t\tLogDriver: \"json-file\",\n\t\tPrivileged: true,\n\t\tNet: \"host\",\n\t\tPid: \"host\",\n\t\tImage: config.OsBase,\n\t\tLabels: map[string]string{\n\t\t\tconfig.ScopeLabel: config.System,\n\t\t},\n\t\tCommand: []string{\"/usr/bin/ros\", \"switch-console\", newConsole},\n\t\tVolumesFrom: []string{\"all-volumes\"},\n\t})\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif err = service.Delete(context.Background(), options.Delete{}); err != nil {\n\t\treturn err\n\t}\n\tif err = service.Up(context.Background(), options.Up{}); err != nil {\n\t\treturn err\n\t}\n\treturn service.Log(context.Background(), true)\n}\n\nfunc consoleEnable(c *cli.Context) error {\n\tif len(c.Args()) != 1 {\n\t\tlog.Fatal(\"Must specify exactly one console to enable\")\n\t}\n\tnewConsole := c.Args()[0]\n\n\tcfg := config.LoadConfig()\n\tvalidateConsole(newConsole, cfg)\n\n\tif newConsole != \"default\" {\n\t\tif err := compose.StageServices(cfg, newConsole); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif err := config.Set(\"rancher.console\", newConsole); err != nil {\n\t\tlog.Errorf(\"Failed to update 'rancher.console': %v\", err)\n\t}\n\n\treturn nil\n}\n\nfunc consoleList(c *cli.Context) error {\n\tcfg := config.LoadConfig()\n\tconsoles := availableConsoles(cfg, c.Bool(\"update\"))\n\tCurrentConsole := CurrentConsole()\n\n\tfor _, console := range consoles {\n\t\tif console == CurrentConsole {\n\t\t\tfmt.Printf(\"current %s\\n\", console)\n\t\t} else if console == cfg.Rancher.Console {\n\t\t\tfmt.Printf(\"enabled %s\\n\", console)\n\t\t} else {\n\t\t\tfmt.Printf(\"disabled %s\\n\", console)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc validateConsole(console string, cfg *config.CloudConfig) {\n\tconsoles := availableConsoles(cfg, false)\n\tif !service.IsLocalOrURL(console) && !util.Contains(consoles, console) {\n\t\tlog.Fatalf(\"%s is not a valid console\", console)\n\t}\n}\n\nfunc availableConsoles(cfg *config.CloudConfig, update bool) []string {\n\tif update {\n\t\terr := network.UpdateCaches(cfg.Rancher.Repositories.ToArray(), \"consoles\")\n\t\tif err != nil {\n\t\t\tlog.Debugf(\"Failed to update console caches: %v\", err)\n\t\t}\n\n\t}\n\tconsoles, err := network.GetConsoles(cfg.Rancher.Repositories.ToArray())\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\tconsoles = append(consoles, \"default\")\n\tsort.Strings(consoles)\n\treturn consoles\n}\n\n// CurrentConsole gets the name of the console that's running\nfunc CurrentConsole() (console string) {\n\t// TODO: replace this docker container look up with a libcompose service lookup?\n\n\t// sudo system-docker inspect --format \"{{.Config.Image}}\" console\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect current console: %v\", err)\n\t\treturn\n\t}\n\tinfo, err := client.ContainerInspect(context.Background(), \"console\")\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect current console: %v\", err)\n\t\treturn\n\t}\n\t// parse image name, then remove os- prefix and the console suffix\n\timage, err := reference.ParseNamed(info.Config.Image)\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect current console(%s): %v\", info.Config.Image, err)\n\t\treturn\n\t}\n\n\tif strings.Contains(image.Name(), \"os-console\") {\n\t\tconsole = \"default\"\n\t\treturn\n\t}\n\tconsole = strings.TrimPrefix(strings.TrimSuffix(image.Name(), \"console\"), \"burmilla/os-\")\n\treturn\n}\n" }, { "path": "cmd/control/console_init.go", "content": "package control\n\nimport (\n\t\"bytes\"\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path\"\n\t\"strconv\"\n\t\"strings\"\n\t\"syscall\"\n\t\"text/template\"\n\n\t\"github.com/burmilla/os/cmd/cloudinitexecute\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/config/cmdline\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n\t\"golang.org/x/crypto/ssh/terminal\"\n\t\"golang.org/x/sys/unix\"\n)\n\nconst (\n\tconsoleDone = \"/run/console-done\"\n\tdockerHome = \"/home/docker\"\n\tgettyCmd = \"/sbin/agetty\"\n\trancherHome = \"/home/rancher\"\n\tstartScript = \"/opt/rancher/bin/start.sh\"\n\trunLockDir = \"/run/lock\"\n\tsshdFile = \"/etc/ssh/sshd_config\"\n\tsshdTplFile = \"/etc/ssh/sshd_config.tpl\"\n)\n\ntype symlink struct {\n\toldname, newname string\n}\n\nfunc consoleInitAction(c *cli.Context) error {\n\treturn consoleInitFunc()\n}\n\nfunc createHomeDir(homedir string, uid, gid int) {\n\tif _, err := os.Stat(homedir); os.IsNotExist(err) {\n\t\tif err := os.MkdirAll(homedir, 0755); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tif err := os.Chown(homedir, uid, gid); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n}\n\nfunc enableBashRC(homedir string, uid, gid int) {\n\tif _, err := os.Stat(homedir + \"/.bash_logout\"); os.IsNotExist(err) {\n\t\tif err := util.FileCopy(\"/etc/skel/.bash_logout\", homedir+\"/.bash_logout\"); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tif err := os.Chown(homedir+\"/.bash_logout\", uid, gid); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tif _, err := os.Stat(homedir + \"/.bashrc\"); os.IsNotExist(err) {\n\t\tif err := util.FileCopy(\"/etc/skel/.bashrc\", homedir+\"/.bashrc\"); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tif err := os.Chown(homedir+\"/.bashrc\", uid, gid); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tif _, err := os.Stat(homedir + \"/.profile\"); os.IsNotExist(err) {\n\t\tif err := util.FileCopy(\"/etc/skel/.profile\", homedir+\"/.profile\"); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tif err := os.Chown(homedir+\"/.profile\", uid, gid); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n}\n\nfunc consoleInitFunc() error {\n\tcfg := config.LoadConfig()\n\n\t// Now that we're booted, stop writing debug messages to the console\n\tcmd := exec.Command(\"sudo\", \"dmesg\", \"--console-off\")\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tcreateHomeDir(rancherHome, 1100, 1100)\n\tcreateHomeDir(dockerHome, 1101, 1101)\n\n\t// who & w command need this file\n\tif _, err := os.Stat(\"/run/utmp\"); os.IsNotExist(err) {\n\t\tf, err := os.OpenFile(\"/run/utmp\", os.O_RDWR|os.O_CREATE, 0644)\n\t\tif err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tdefer f.Close()\n\t}\n\n\t// last command need this file\n\tif _, err := os.Stat(\"/var/log/wtmp\"); os.IsNotExist(err) {\n\t\tf, err := os.OpenFile(\"/var/log/wtmp\", os.O_RDWR|os.O_CREATE, 0644)\n\t\tif err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t\tdefer f.Close()\n\t}\n\n\t// some software need this dir, like open-iscsi\n\tif _, err := os.Stat(runLockDir); os.IsNotExist(err) {\n\t\tif err = os.Mkdir(runLockDir, 0755); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tignorePassword := false\n\tfor _, d := range cfg.Rancher.Disable {\n\t\tif d == \"password\" {\n\t\t\tignorePassword = true\n\t\t\tbreak\n\t\t}\n\t}\n\n\tpassword := cmdline.GetCmdline(\"rancher.password\")\n\tif !ignorePassword && password != \"\" {\n\t\tcmd := exec.Command(\"chpasswd\")\n\t\tcmd.Stdin = strings.NewReader(fmt.Sprint(\"rancher:\", password))\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\n\t\tcmd = exec.Command(\"bash\", \"-c\", `sed -E -i 's/(rancher:.*:).*(:.*:.*:.*:.*:.*:.*)$/\\1\\2/' /etc/shadow`)\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tconst pollInfo = `#!/bin/sh\nexport TERM=xterm-256color\n\necho \"\n\n\n$(tput setaf 3)\n --------------------------------------------------\n | Dear Burmilla OS user, |\n | Please, answer to poll in $(tput setaf 4)burmillaos.org/poll$(tput setaf 3) |\n | about your main Burmilla OS use case. |\n | |\n | Thank you advance. |\n | |\n | You can disable this message with command: |\n | $(tput setaf 5)sudo chmod a-x /etc/update-motd.d/1-burmillaos-1$(tput setaf 3) |\n --------------------------------------------------\n$(tput sgr0)\n\n\n\"\n`\n\tif _, err := os.Stat(\"/etc/update-motd.d/1-burmillaos-1\"); os.IsNotExist(err) {\n\t\tif err := ioutil.WriteFile(\"/etc/update-motd.d/1-burmillaos-1\", []byte(pollInfo), 0755); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tif err := setupSSH(cfg); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif err := writeRespawn(\"rancher\", cfg.Rancher.SSH.Daemon, false); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif err := modifySshdConfig(cfg); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tp, err := compose.GetProject(cfg, false, true)\n\tif err != nil {\n\t\tlog.Error(err)\n\t}\n\n\t// check the multi engine service & generate the multi engine script\n\tfor _, key := range p.ServiceConfigs.Keys() {\n\t\tserviceConfig, ok := p.ServiceConfigs.Get(key)\n\t\tif !ok {\n\t\t\tlog.Errorf(\"Failed to get service config from the project\")\n\t\t\tcontinue\n\t\t}\n\t\tif _, ok := serviceConfig.Labels[config.UserDockerLabel]; ok {\n\t\t\terr = util.GenerateDindEngineScript(serviceConfig.Labels[config.UserDockerLabel])\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"Failed to generate engine script: %v\", err)\n\t\t\t\tcontinue\n\t\t\t}\n\t\t}\n\t}\n\n\t// create Docker CLI plugins folder\n\tif _, err := os.Stat(\"/usr/libexec/docker/cli-plugins\"); os.IsNotExist(err) {\n\t\tif err = os.MkdirAll(\"/usr/libexec/docker/cli-plugins\", 0755); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tbaseSymlink := symLinkEngineBinary()\n\n\tif _, err := os.Stat(dockerCompletionFile); err == nil {\n\t\tbaseSymlink = append(baseSymlink, symlink{\n\t\t\tdockerCompletionFile, dockerCompletionLinkFile,\n\t\t})\n\t}\n\n\tfor _, link := range baseSymlink {\n\t\tsyscall.Unlink(link.newname)\n\t\tif err := os.Symlink(link.oldname, link.newname); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\t// mount systemd cgroups\n\tif err := os.MkdirAll(\"/sys/fs/cgroup/systemd\", 0555); err != nil {\n\t\tlog.Error(err)\n\t}\n\tif err := unix.Mount(\"cgroup\", \"/sys/fs/cgroup/systemd\", \"cgroup\", 0, \"none,name=systemd\"); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\t// font backslashes need to be escaped for when issue is output! (but not the others..)\n\tif err := ioutil.WriteFile(\"/etc/issue\", []byte(config.Banner), 0644); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\t// write out a profile.d file for the proxy settings.\n\t// maybe write these on the host and bindmount into everywhere?\n\tproxyLines := []string{}\n\tfor _, k := range []string{\"http_proxy\", \"HTTP_PROXY\", \"https_proxy\", \"HTTPS_PROXY\", \"no_proxy\", \"NO_PROXY\"} {\n\t\tif v, ok := cfg.Rancher.Environment[k]; ok {\n\t\t\tproxyLines = append(proxyLines, fmt.Sprintf(\"export %s=%q\", k, v))\n\t\t}\n\t}\n\n\tif len(proxyLines) > 0 {\n\t\tproxyString := strings.Join(proxyLines, \"\\n\")\n\t\tproxyString = fmt.Sprintf(\"#!/bin/sh\\n%s\\n\", proxyString)\n\t\tif err := ioutil.WriteFile(\"/etc/profile.d/proxy.sh\", []byte(proxyString), 0755); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\t// write out a profile.d file for the PATH settings.\n\tpathLines := []string{}\n\tfor _, k := range []string{\"PATH\", \"path\"} {\n\t\tif v, ok := cfg.Rancher.Environment[k]; ok {\n\t\t\tfor _, p := range strings.Split(v, \",\") {\n\t\t\t\tpathLines = append(pathLines, fmt.Sprintf(\"export PATH=$PATH:%s\", strings.TrimSpace(p)))\n\t\t\t}\n\t\t}\n\t}\n\tif len(pathLines) > 0 {\n\t\tpathString := strings.Join(pathLines, \"\\n\")\n\t\tpathString = fmt.Sprintf(\"#!/bin/sh\\n%s\\n\", pathString)\n\t\tif err := ioutil.WriteFile(\"/etc/profile.d/path.sh\", []byte(pathString), 0755); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tcmd = exec.Command(\"bash\", \"-c\", `echo $(/sbin/ifconfig | grep -B1 \"inet\" |awk '{ if ( $1 == \"inet\" ) { print $2 } else if ( $3 == \"mtu\" ) { printf \"%s:\" ,$1 } }' |awk -F: '{ print $1 \": \" $3}') >> /etc/issue`)\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tcloudinitexecute.ApplyConsole(cfg)\n\n\tif err := util.RunScript(config.CloudConfigScriptFile); err != nil {\n\t\tlog.Error(err)\n\t}\n\tif err := util.RunScript(startScript); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif err := ioutil.WriteFile(consoleDone, []byte(CurrentConsole()), 0644); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\t// Check if user Docker has ever run in this installation yet and switch to latest/user defined version if not\n\tif _, err := os.Stat(\"/var/lib/docker/engine-id\"); os.IsNotExist(err) {\n\t\tdockerVersion := \"latest\"\n\t\tif cfg.Rancher.Docker.Engine != dockerVersion {\n\t\t\tdockerVersion = cfg.Rancher.Docker.Engine\n\t\t}\n\t\tlog.Warn(\"User Docker does not exist, switching to \" + dockerVersion)\n\t\tcmd := exec.Command(\"/usr/bin/ros\", \"engine\", \"switch\", dockerVersion)\n\t\tcmd.Stdout = os.Stdout\n\t\tcmd.Stderr = os.Stderr\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tif err := util.RunScript(\"/etc/rc.local\"); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif err := util.RunScript(\"/etc/init.d/apparmor\", \"start\"); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\t// Enable Bash colors\n\tenableBashRC(\"/root\", 0, 0)\n\tenableBashRC(rancherHome, 1100, 1100)\n\tenableBashRC(dockerHome, 1101, 1101)\n\n\tos.Setenv(\"TERM\", \"linux\")\n\n\trespawnBinPath, err := exec.LookPath(\"respawn\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn syscall.Exec(respawnBinPath, []string{\"respawn\", \"-f\", \"/etc/respawn.conf\"}, os.Environ())\n}\n\nfunc generateRespawnConf(cmdline, user string, sshd, recovery bool) string {\n\tvar respawnConf bytes.Buffer\n\n\tautologinBin := \"/usr/bin/autologin\"\n\tif recovery {\n\t\tautologinBin = \"/usr/bin/recovery\"\n\t}\n\n\tconfig := config.LoadConfig()\n\n\tallowAutoLogin := true\n\tfor _, d := range config.Rancher.Disable {\n\t\tif d == \"autologin\" {\n\t\t\tallowAutoLogin = false\n\t\t\tbreak\n\t\t}\n\t}\n\n\tfor i := 1; i < 7; i++ {\n\t\ttty := fmt.Sprintf(\"tty%d\", i)\n\t\tif !istty(tty) {\n\t\t\tcontinue\n\t\t}\n\n\t\trespawnConf.WriteString(gettyCmd)\n\t\tif allowAutoLogin && strings.Contains(cmdline, fmt.Sprintf(\"rancher.autologin=%s\", tty)) {\n\t\t\trespawnConf.WriteString(fmt.Sprintf(\" -n -l %s -o %s:tty%d\", autologinBin, user, i))\n\t\t}\n\t\trespawnConf.WriteString(fmt.Sprintf(\" --noclear %s linux\\n\", tty))\n\t}\n\n\tfor _, tty := range []string{\"ttyS0\", \"ttyS1\", \"ttyS2\", \"ttyS3\", \"ttyAMA0\"} {\n\t\tif !strings.Contains(cmdline, fmt.Sprintf(\"console=%s\", tty)) {\n\t\t\tcontinue\n\t\t}\n\n\t\tif !istty(tty) {\n\t\t\tcontinue\n\t\t}\n\n\t\trespawnConf.WriteString(gettyCmd)\n\t\tif allowAutoLogin && strings.Contains(cmdline, fmt.Sprintf(\"rancher.autologin=%s\", tty)) {\n\t\t\trespawnConf.WriteString(fmt.Sprintf(\" -n -l %s -o %s:%s\", autologinBin, user, tty))\n\t\t}\n\t\trespawnConf.WriteString(fmt.Sprintf(\" %s\\n\", tty))\n\t}\n\n\tif sshd {\n\t\trespawnConf.WriteString(\"/usr/sbin/sshd -D\")\n\t}\n\n\treturn respawnConf.String()\n}\n\nfunc writeRespawn(user string, sshd, recovery bool) error {\n\tcmdline, err := ioutil.ReadFile(\"/proc/cmdline\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\trespawn := generateRespawnConf(string(cmdline), user, sshd, recovery)\n\n\tfiles, err := ioutil.ReadDir(\"/etc/respawn.conf.d\")\n\tif err == nil {\n\t\tfor _, f := range files {\n\t\t\tp := path.Join(\"/etc/respawn.conf.d\", f.Name())\n\t\t\tcontent, err := ioutil.ReadFile(p)\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"Failed to read %s: %v\", p, err)\n\t\t\t\tcontinue\n\t\t\t}\n\t\t\trespawn += fmt.Sprintf(\"\\n%s\", string(content))\n\t\t}\n\t} else if !os.IsNotExist(err) {\n\t\tlog.Error(err)\n\t}\n\n\treturn ioutil.WriteFile(\"/etc/respawn.conf\", []byte(respawn), 0644)\n}\n\nfunc modifySshdConfig(cfg *config.CloudConfig) error {\n\t_, err := os.Stat(sshdTplFile)\n\tif err == nil {\n\t\tos.Remove(sshdFile)\n\t\tsshdTpl, err := template.ParseFiles(sshdTplFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tf, err := os.OpenFile(sshdFile, os.O_WRONLY|os.O_CREATE, 0644)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tdefer f.Close()\n\n\t\tconfig := map[string]string{}\n\t\tif cfg.Rancher.SSH.Port > 0 && cfg.Rancher.SSH.Port < 65355 {\n\t\t\tconfig[\"Port\"] = strconv.Itoa(cfg.Rancher.SSH.Port)\n\t\t}\n\t\tif cfg.Rancher.SSH.ListenAddress != \"\" {\n\t\t\tconfig[\"ListenAddress\"] = cfg.Rancher.SSH.ListenAddress\n\t\t}\n\n\t\treturn sshdTpl.Execute(f, config)\n\t} else if os.IsNotExist(err) {\n\t\treturn nil\n\t}\n\n\treturn err\n}\n\nfunc setupSSH(cfg *config.CloudConfig) error {\n\tfor _, keyType := range []string{\"rsa\", \"ed25519\"} {\n\t\toutputFile := fmt.Sprintf(\"/etc/ssh/ssh_host_%s_key\", keyType)\n\t\toutputFilePub := fmt.Sprintf(\"/etc/ssh/ssh_host_%s_key.pub\", keyType)\n\n\t\tif _, err := os.Stat(outputFile); err == nil {\n\t\t\tcontinue\n\t\t}\n\n\t\tsaved, savedExists := cfg.Rancher.SSH.Keys[keyType]\n\t\tpub, pubExists := cfg.Rancher.SSH.Keys[keyType+\"-pub\"]\n\n\t\tif savedExists && pubExists {\n\t\t\t// TODO check permissions\n\t\t\tif err := util.WriteFileAtomic(outputFile, []byte(saved), 0600); err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t\tif err := util.WriteFileAtomic(outputFilePub, []byte(pub), 0600); err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t\tcontinue\n\t\t}\n\n\t\tcmd := exec.Command(\"bash\", \"-c\", fmt.Sprintf(\"ssh-keygen -f %s -N '' -t %s\", outputFile, keyType))\n\t\tif err := cmd.Run(); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tsavedBytes, err := ioutil.ReadFile(outputFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tpubBytes, err := ioutil.ReadFile(outputFilePub)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tconfig.Set(fmt.Sprintf(\"rancher.ssh.keys.%s\", keyType), string(savedBytes))\n\t\tconfig.Set(fmt.Sprintf(\"rancher.ssh.keys.%s-pub\", keyType), string(pubBytes))\n\t}\n\n\treturn os.MkdirAll(\"/var/run/sshd\", 0644)\n}\n\nfunc istty(name string) bool {\n\tif f, err := os.Open(fmt.Sprintf(\"/dev/%s\", name)); err == nil {\n\t\treturn terminal.IsTerminal(int(f.Fd()))\n\t}\n\treturn false\n}\n" }, { "path": "cmd/control/dev.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nfunc devAction(c *cli.Context) error {\n\tif len(c.Args()) > 0 {\n\t\tfmt.Println(util.ResolveDevice(c.Args()[0]))\n\t}\n\treturn nil\n}\n" }, { "path": "cmd/control/docker_init.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"path\"\n\t\"strings\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nconst (\n\tdockerConf = \"/var/lib/rancher/conf/docker\"\n\tdockerDone = \"/run/docker-done\"\n\tdockerLog = \"/var/log/docker.log\"\n\tdockerCompletionLinkFile = \"/usr/share/bash-completion/completions/docker\"\n\tdockerCompletionFile = \"/var/lib/rancher/engine/completion\"\n)\n\nfunc dockerInitAction(c *cli.Context) error {\n\t// TODO: this should be replaced by a \"Console ready event watcher\"\n\tfor {\n\t\tif _, err := os.Stat(consoleDone); err == nil {\n\t\t\tbreak\n\t\t}\n\t\ttime.Sleep(200 * time.Millisecond)\n\t}\n\n\tif _, err := os.Stat(dockerCompletionFile); err != nil {\n\t\tif _, err := os.Readlink(dockerCompletionLinkFile); err == nil {\n\t\t\tsyscall.Unlink(dockerCompletionLinkFile)\n\t\t}\n\t}\n\n\tdockerBin := \"\"\n\tdockerPaths := []string{\n\t\t\"/usr/bin\",\n\t\t\"/opt/bin\",\n\t\t\"/usr/local/bin\",\n\t\t\"/var/lib/rancher/docker\",\n\t}\n\tfor _, binPath := range dockerPaths {\n\t\tif util.ExistsAndExecutable(path.Join(binPath, \"dockerd\")) {\n\t\t\tdockerBin = path.Join(binPath, \"dockerd\")\n\t\t\tbreak\n\t\t}\n\t}\n\tif dockerBin == \"\" {\n\t\tfor _, binPath := range dockerPaths {\n\t\t\tif util.ExistsAndExecutable(path.Join(binPath, \"docker\")) {\n\t\t\t\tdockerBin = path.Join(binPath, \"docker\")\n\t\t\t\tbreak\n\t\t\t}\n\t\t}\n\t}\n\tif dockerBin == \"\" {\n\t\terr := fmt.Errorf(\"Failed to find either dockerd or docker binaries\")\n\t\tlog.Error(err)\n\t\treturn err\n\t}\n\tlog.Infof(\"Found %s\", dockerBin)\n\n\tif err := syscall.Mount(\"\", \"/\", \"\", syscall.MS_SHARED|syscall.MS_REC, \"\"); err != nil {\n\t\tlog.Error(err)\n\t}\n\tif err := syscall.Mount(\"\", \"/run\", \"\", syscall.MS_SHARED|syscall.MS_REC, \"\"); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tmountInfo, err := ioutil.ReadFile(\"/proc/self/mountinfo\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor _, mount := range strings.Split(string(mountInfo), \"\\n\") {\n\t\tif strings.Contains(mount, \"/var/lib/user-docker /var/lib/docker\") && strings.Contains(mount, \"rootfs\") {\n\t\t\tos.Setenv(\"DOCKER_RAMDISK\", \"true\")\n\t\t}\n\t}\n\n\tcfg := config.LoadConfig()\n\n\tfor _, link := range symLinkEngineBinary() {\n\t\tsyscall.Unlink(link.newname)\n\t\tif _, err := os.Stat(link.oldname); err == nil {\n\t\t\tif err := os.Symlink(link.oldname, link.newname); err != nil {\n\t\t\t\tlog.Error(err)\n\t\t\t}\n\t\t}\n\t}\n\n\terr = checkZfsBackingFS(cfg.Rancher.Docker.StorageDriver, cfg.Rancher.Docker.DataRoot)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\targs := []string{\n\t\t\"bash\",\n\t\t\"-c\",\n\t\tfmt.Sprintf(`[ -e %s ] && source %s; exec /usr/bin/dockerlaunch %s %s $DOCKER_OPTS >> %s 2>&1`, dockerConf, dockerConf, dockerBin, strings.Join(c.Args(), \" \"), dockerLog),\n\t}\n\n\t// TODO: this should be replaced by a \"Docker ready event watcher\"\n\tif err := ioutil.WriteFile(dockerDone, []byte(CurrentEngine()), 0644); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\treturn syscall.Exec(\"/bin/bash\", args, os.Environ())\n}\n" }, { "path": "cmd/control/engine.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"net\"\n\t\"os\"\n\t\"path\"\n\t\"sort\"\n\t\"strconv\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/cmd/control/service\"\n\t\"github.com/burmilla/os/cmd/control/service/app\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\t\"github.com/burmilla/os/pkg/util/network\"\n\t\"github.com/burmilla/os/pkg/util/versions\"\n\n\tyaml \"github.com/cloudfoundry-incubator/candiedyaml\"\n\t\"github.com/codegangsta/cli\"\n\t\"github.com/docker/docker/reference\"\n\t\"github.com/docker/engine-api/types\"\n\t\"github.com/docker/engine-api/types/filters\"\n\tcomposeConfig \"github.com/docker/libcompose/config\"\n\t\"github.com/docker/libcompose/project/options\"\n\tcomposeYaml \"github.com/docker/libcompose/yaml\"\n\t\"github.com/pkg/errors\"\n\t\"golang.org/x/net/context\"\n)\n\nfunc engineSubcommands() []cli.Command {\n\treturn []cli.Command{\n\t\t{\n\t\t\tName: \"switch\",\n\t\t\tUsage: \"switch user Docker engine without a reboot\",\n\t\t\tAction: engineSwitch,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"force, f\",\n\t\t\t\t\tUsage: \"do not prompt for input\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"no-pull\",\n\t\t\t\t\tUsage: \"don't pull console image\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"create\",\n\t\t\tUsage: \"create Dind engine without a reboot\",\n\t\t\tDescription: \"must switch user docker to 17.12.1 or earlier if using Dind\",\n\t\t\tArgsUsage: \"\",\n\t\t\tBefore: preFlightValidate,\n\t\t\tAction: engineCreate,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"version, v\",\n\t\t\t\t\tValue: config.DefaultDind,\n\t\t\t\t\tUsage: fmt.Sprintf(\"set the version for the engine, %s are available\", config.SupportedDinds),\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"network\",\n\t\t\t\t\tUsage: \"set the network for the engine\",\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"fixed-ip\",\n\t\t\t\t\tUsage: \"set the fixed ip for the engine\",\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"ssh-port\",\n\t\t\t\t\tUsage: \"set the ssh port for the engine\",\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"authorized-keys\",\n\t\t\t\t\tUsage: \"set the ssh authorized_keys absolute path for the engine\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"rm\",\n\t\t\tUsage: \"remove Dind engine without a reboot\",\n\t\t\tArgsUsage: \"\",\n\t\t\tBefore: func(c *cli.Context) error {\n\t\t\t\tif len(c.Args()) != 1 {\n\t\t\t\t\treturn errors.New(\"Must specify exactly one Docker engine to remove\")\n\t\t\t\t}\n\t\t\t\treturn nil\n\t\t\t},\n\t\t\tAction: dindEngineRemove,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.IntFlag{\n\t\t\t\t\tName: \"timeout,t\",\n\t\t\t\t\tUsage: \"specify a shutdown timeout in seconds\",\n\t\t\t\t\tValue: 10,\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"force, f\",\n\t\t\t\t\tUsage: \"do not prompt for input\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"enable\",\n\t\t\tUsage: \"set user Docker engine to be switched on next reboot\",\n\t\t\tAction: engineEnable,\n\t\t},\n\t\t{\n\t\t\tName: \"list\",\n\t\t\tUsage: \"list available Docker engines (include the Dind engines)\",\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"update, u\",\n\t\t\t\t\tUsage: \"update engine cache\",\n\t\t\t\t},\n\t\t\t},\n\t\t\tAction: engineList,\n\t\t},\n\t}\n}\n\nfunc engineSwitch(c *cli.Context) error {\n\tif len(c.Args()) != 1 {\n\t\tlog.Fatal(\"Must specify exactly one Docker engine to switch to\")\n\t}\n\tnewEngine := c.Args()[0]\n\n\tcfg := config.LoadConfig()\n\n\tif newEngine == \"latest\" {\n\t\tengines := availableEngines(cfg, true)\n\t\tnewEngine = engines[len(engines)-1]\n\t\tcurrentEngine := CurrentEngine()\n\t\tif newEngine == currentEngine {\n\t\t\tlog.Infof(\"Latest engine %s is already running\", newEngine)\n\t\t\treturn nil\n\t\t}\n\t\tlog.Infof(\"Switching to engine %s\", newEngine)\n\t} else {\n\t\tvalidateEngine(newEngine, cfg)\n\t}\n\n\tproject, err := compose.GetProject(cfg, true, false)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tif err = project.Stop(context.Background(), 10, \"docker\"); err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tif err = compose.LoadSpecialService(project, cfg, \"docker\", newEngine); err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tif err = project.Up(context.Background(), options.Up{}, \"docker\"); err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tif err := config.Set(\"rancher.docker.engine\", newEngine); err != nil {\n\t\tlog.Errorf(\"Failed to update rancher.docker.engine: %v\", err)\n\t}\n\n\treturn nil\n}\n\nfunc engineCreate(c *cli.Context) error {\n\tname := c.Args()[0]\n\tversion := c.String(\"version\")\n\tsshPort, _ := strconv.Atoi(c.String(\"ssh-port\"))\n\tif sshPort <= 0 {\n\t\tsshPort = randomSSHPort()\n\t}\n\tauthorizedKeys := c.String(\"authorized-keys\")\n\tnetwork := c.String(\"network\")\n\tfixedIP := c.String(\"fixed-ip\")\n\n\t// generate & create engine compose\n\terr := generateEngineCompose(name, version, sshPort, authorizedKeys, network, fixedIP)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// stage engine service\n\tcfg := config.LoadConfig()\n\tvar enabledServices []string\n\tif val, ok := cfg.Rancher.ServicesInclude[name]; !ok || !val {\n\t\tcfg.Rancher.ServicesInclude[name] = true\n\t\tenabledServices = append(enabledServices, name)\n\t}\n\n\tif len(enabledServices) > 0 {\n\t\tif err := compose.StageServices(cfg, enabledServices...); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\n\t\tif err := config.Set(\"rancher.services_include\", cfg.Rancher.ServicesInclude); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\t// generate engine script\n\terr = util.GenerateDindEngineScript(name)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\treturn nil\n}\n\nfunc dindEngineRemove(c *cli.Context) error {\n\tif !c.Bool(\"force\") {\n\t\tif !yes(\"Continue\") {\n\t\t\treturn nil\n\t\t}\n\t}\n\n\t// app.ProjectDelete needs to use this flag\n\t// Allow deletion of the Dind engine\n\tc.Set(\"force\", \"true\")\n\t// Remove volumes associated with the Dind engine container\n\tc.Set(\"v\", \"true\")\n\n\tname := c.Args()[0]\n\tcfg := config.LoadConfig()\n\tp, err := compose.GetProject(cfg, true, false)\n\tif err != nil {\n\t\tlog.Fatalf(\"Get project failed: %v\", err)\n\t}\n\n\t// 1. service stop\n\terr = app.ProjectStop(p, c)\n\tif err != nil {\n\t\tlog.Fatalf(\"Stop project service failed: %v\", err)\n\t}\n\n\t// 2. service delete\n\terr = app.ProjectDelete(p, c)\n\tif err != nil {\n\t\tlog.Fatalf(\"Delete project service failed: %v\", err)\n\t}\n\n\t// 3. service delete\n\tif _, ok := cfg.Rancher.ServicesInclude[name]; !ok {\n\t\tlog.Fatalf(\"Failed to found enabled service %s\", name)\n\t}\n\n\tdelete(cfg.Rancher.ServicesInclude, name)\n\n\tif err = config.Set(\"rancher.services_include\", cfg.Rancher.ServicesInclude); err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\t// 4. remove service from file\n\terr = RemoveEngineFromCompose(name)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\t// 5. remove dind engine script\n\terr = util.RemoveDindEngineScript(name)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn nil\n}\n\nfunc engineEnable(c *cli.Context) error {\n\tif len(c.Args()) != 1 {\n\t\tlog.Fatal(\"Must specify exactly one Docker engine to enable\")\n\t}\n\tnewEngine := c.Args()[0]\n\n\tcfg := config.LoadConfig()\n\tvalidateEngine(newEngine, cfg)\n\n\tif err := compose.StageServices(cfg, newEngine); err != nil {\n\t\treturn err\n\t}\n\n\tif err := config.Set(\"rancher.docker.engine\", newEngine); err != nil {\n\t\tlog.Errorf(\"Failed to update 'rancher.docker.engine': %v\", err)\n\t}\n\n\treturn nil\n}\n\nfunc engineList(c *cli.Context) error {\n\tcfg := config.LoadConfig()\n\tengines := availableEngines(cfg, c.Bool(\"update\"))\n\tcurrentEngine := CurrentEngine()\n\n\ti := 1\n\tfor _, engine := range engines {\n\t\tif engine == currentEngine {\n\t\t\tif i == len(engines) {\n\t\t\t\tfmt.Printf(\"current %s (latest)\\n\", engine)\n\t\t\t} else {\n\t\t\t\tfmt.Printf(\"current %s\\n\", engine)\n\t\t\t}\n\t\t} else if engine == cfg.Rancher.Docker.Engine {\n\t\t\tif i == len(engines) {\n\t\t\t\tfmt.Printf(\"enabled %s (latest)\\n\", engine)\n\t\t\t} else {\n\t\t\t\tfmt.Printf(\"enabled %s\\n\", engine)\n\t\t\t}\n\t\t} else {\n\t\t\tif i == len(engines) {\n\t\t\t\tfmt.Printf(\"disabled %s (latest)\\n\", engine)\n\t\t\t} else {\n\t\t\t\tfmt.Printf(\"disabled %s\\n\", engine)\n\t\t\t}\n\t\t}\n\t\ti++\n\t}\n\n\t// check the dind container\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect dind: %v\", err)\n\t\treturn nil\n\t}\n\n\tfilter := filters.NewArgs()\n\tfilter.Add(\"label\", config.UserDockerLabel)\n\topts := types.ContainerListOptions{\n\t\tAll: true,\n\t\tFilter: filter,\n\t}\n\tcontainers, err := client.ContainerList(context.Background(), opts)\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect dind: %v\", err)\n\t\treturn nil\n\t}\n\tfor _, c := range containers {\n\t\tif c.State == \"running\" {\n\t\t\tfmt.Printf(\"enabled %s\\n\", c.Labels[config.UserDockerLabel])\n\t\t} else {\n\t\t\tfmt.Printf(\"disabled %s\\n\", c.Labels[config.UserDockerLabel])\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc validateEngine(engine string, cfg *config.CloudConfig) {\n\tengines := availableEngines(cfg, false)\n\tif !service.IsLocalOrURL(engine) && !util.Contains(engines, engine) {\n\t\tlog.Fatalf(\"%s is not a valid engine\", engine)\n\t}\n}\n\nfunc availableEngines(cfg *config.CloudConfig, update bool) []string {\n\tif update {\n\t\terr := network.UpdateCaches(cfg.Rancher.Repositories.ToArray(), \"engines\")\n\t\tif err != nil {\n\t\t\tlog.Debugf(\"Failed to update engine caches: %v\", err)\n\t\t}\n\n\t}\n\tengines, err := network.GetEngines(cfg.Rancher.Repositories.ToArray())\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\tsort.Strings(engines)\n\treturn engines\n}\n\n// CurrentEngine gets the name of the docker that's running\nfunc CurrentEngine() (engine string) {\n\t// sudo system-docker inspect --format \"{{.Config.Image}}\" docker\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect current docker: %v\", err)\n\t\treturn\n\t}\n\tinfo, err := client.ContainerInspect(context.Background(), \"docker\")\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect current docker: %v\", err)\n\t\treturn\n\t}\n\t// parse image name, then remove os- prefix and the engine suffix\n\timage, err := reference.ParseNamed(info.Config.Image)\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to detect current docker(%s): %v\", info.Config.Image, err)\n\t\treturn\n\t}\n\tif t, ok := image.(reference.NamedTagged); ok {\n\t\ttag := t.Tag()\n\n\t\t// compatible with some patch image tags, such as 17.12.1-1,17.06.2-1,...\n\t\ttag = strings.SplitN(tag, \"-\", 2)[0]\n\n\t\tif !strings.HasPrefix(tag, \"1.\") && versions.LessThan(tag, \"18.09.0\") {\n\t\t\t// >= 18.09.0, docker-\n\t\t\t// < 18.09.0 and >= 16.03, docker--ce\n\t\t\t// < 17.03, docker-\n\t\t\ttag = tag + \"-ce\"\n\t\t}\n\t\treturn \"docker-\" + tag\n\t}\n\n\treturn\n}\n\nfunc preFlightValidate(c *cli.Context) error {\n\tif len(c.Args()) != 1 {\n\t\treturn errors.New(\"Must specify one engine name\")\n\t}\n\tname := c.Args()[0]\n\tif name == \"\" {\n\t\treturn errors.New(\"Must specify one engine name\")\n\t}\n\n\tversion := c.String(\"version\")\n\tif version == \"\" {\n\t\treturn errors.New(\"Must specify one engine version\")\n\t}\n\n\tauthorizedKeys := c.String(\"authorized-keys\")\n\tif authorizedKeys != \"\" {\n\t\tif _, err := os.Stat(authorizedKeys); os.IsNotExist(err) {\n\t\t\treturn errors.New(\"The authorized-keys should be an exist file, recommended to put in the /opt or /var/lib/rancher directory\")\n\t\t}\n\t}\n\n\tnetwork := c.String(\"network\")\n\tif network == \"\" {\n\t\treturn errors.New(\"Must specify network\")\n\t}\n\n\tuserDefineNetwork, err := CheckUserDefineNetwork(network)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfixedIP := c.String(\"fixed-ip\")\n\tif fixedIP == \"\" {\n\t\treturn errors.New(\"Must specify fix ip\")\n\t}\n\n\terr = CheckUserDefineIPv4Address(fixedIP, *userDefineNetwork)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tisVersionMatch := false\n\tfor _, v := range config.SupportedDinds {\n\t\tif v == version {\n\t\t\tisVersionMatch = true\n\t\t\tbreak\n\t\t}\n\t}\n\n\tif !isVersionMatch {\n\t\treturn errors.Errorf(\"Engine version not supported only %v are supported\", config.SupportedDinds)\n\t}\n\n\tif c.String(\"ssh-port\") != \"\" {\n\t\tport, err := strconv.Atoi(c.String(\"ssh-port\"))\n\t\tif err != nil {\n\t\t\treturn errors.Wrap(err, \"Failed to convert ssh port to Int\")\n\t\t}\n\t\tif port > 0 {\n\t\t\taddr, err := net.ResolveTCPAddr(\"tcp\", \"localhost:\"+strconv.Itoa(port))\n\t\t\tif err != nil {\n\t\t\t\treturn errors.Errorf(\"Failed to resolve tcp addr: %v\", err)\n\t\t\t}\n\t\t\tl, err := net.ListenTCP(\"tcp\", addr)\n\t\t\tif err != nil {\n\t\t\t\treturn errors.Errorf(\"Failed to listen tcp: %v\", err)\n\t\t\t}\n\t\t\tdefer l.Close()\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc randomSSHPort() int {\n\taddr, err := net.ResolveTCPAddr(\"tcp\", \"localhost:0\")\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to resolve tcp addr: %v\", err)\n\t\treturn 0\n\t}\n\n\tl, err := net.ListenTCP(\"tcp\", addr)\n\tif err != nil {\n\t\treturn 0\n\t}\n\tdefer l.Close()\n\treturn l.Addr().(*net.TCPAddr).Port\n}\n\nfunc generateEngineCompose(name, version string, sshPort int, authorizedKeys, network, fixedIP string) error {\n\tif err := os.MkdirAll(path.Dir(config.MultiDockerConfFile), 0700); err != nil && !os.IsExist(err) {\n\t\tlog.Errorf(\"Failed to create directory for file %s: %v\", config.MultiDockerConfFile, err)\n\t\treturn err\n\t}\n\n\tcomposeConfigs := map[string]composeConfig.ServiceConfigV1{}\n\n\tif _, err := os.Stat(config.MultiDockerConfFile); err == nil {\n\t\t// read from engine compose\n\t\tbytes, err := ioutil.ReadFile(config.MultiDockerConfFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\terr = yaml.Unmarshal(bytes, &composeConfigs)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif err := os.MkdirAll(config.MultiDockerDataDir+\"/\"+name, 0700); err != nil && !os.IsExist(err) {\n\t\tlog.Errorf(\"Failed to create directory for file %s: %v\", config.MultiDockerDataDir+\"/\"+name, err)\n\t\treturn err\n\t}\n\n\tvolumes := []string{\n\t\t\"/lib/modules:/lib/modules\",\n\t\tconfig.MultiDockerDataDir + \"/\" + name + \":\" + config.MultiDockerDataDir + \"/\" + name,\n\t}\n\tif authorizedKeys != \"\" {\n\t\tvolumes = append(volumes, authorizedKeys+\":/root/.ssh/authorized_keys\")\n\t}\n\n\tcomposeConfigs[name] = composeConfig.ServiceConfigV1{\n\t\tImage: \"${REGISTRY_DOMAIN}/\" + version,\n\t\tRestart: \"always\",\n\t\tPrivileged: true,\n\t\tNet: network,\n\t\tPorts: []string{strconv.Itoa(sshPort) + \":22\"},\n\t\tVolumes: volumes,\n\t\tVolumesFrom: []string{},\n\t\tCommand: composeYaml.Command{\n\t\t\t\"--storage-driver=overlay2\",\n\t\t\t\"--data-root=\" + config.MultiDockerDataDir + \"/\" + name,\n\t\t\t\"--host=unix://\" + config.MultiDockerDataDir + \"/\" + name + \"/docker-\" + name + \".sock\",\n\t\t},\n\t\tLabels: composeYaml.SliceorMap{\n\t\t\t\"io.rancher.os.scope\": \"system\",\n\t\t\t\"io.rancher.os.after\": \"console\",\n\t\t\tconfig.UserDockerLabel: name,\n\t\t\tconfig.UserDockerNetLabel: network,\n\t\t\tconfig.UserDockerFIPLabel: fixedIP,\n\t\t},\n\t}\n\n\tbytes, err := yaml.Marshal(composeConfigs)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn ioutil.WriteFile(config.MultiDockerConfFile, bytes, 0640)\n}\n\nfunc RemoveEngineFromCompose(name string) error {\n\tcomposeConfigs := map[string]composeConfig.ServiceConfigV1{}\n\n\tif _, err := os.Stat(config.MultiDockerConfFile); err == nil {\n\t\t// read from engine compose\n\t\tbytes, err := ioutil.ReadFile(config.MultiDockerConfFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\terr = yaml.Unmarshal(bytes, &composeConfigs)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tdelete(composeConfigs, name)\n\n\tbytes, err := yaml.Marshal(composeConfigs)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn ioutil.WriteFile(config.MultiDockerConfFile, bytes, 0640)\n}\n\nfunc CheckUserDefineNetwork(name string) (*types.NetworkResource, error) {\n\tsystemClient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\tnetworks, err := systemClient.NetworkList(context.Background(), types.NetworkListOptions{})\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\tfor _, network := range networks {\n\t\tif network.Name == name {\n\t\t\treturn &network, nil\n\t\t}\n\t}\n\n\treturn nil, errors.Errorf(\"Failed to found the user define network: %s\", name)\n}\n\nfunc CheckUserDefineIPv4Address(ipv4 string, network types.NetworkResource) error {\n\tfor _, config := range network.IPAM.Config {\n\t\t_, ipnet, _ := net.ParseCIDR(config.Subnet)\n\t\tif ipnet.Contains(net.ParseIP(ipv4)) {\n\t\t\treturn nil\n\t\t}\n\t}\n\treturn errors.Errorf(\"IP %s is not in the specified cidr\", ipv4)\n}\n" }, { "path": "cmd/control/entrypoint.go", "content": "package control\n\nimport (\n\t\"os\"\n\t\"os/exec\"\n\t\"syscall\"\n\n\t\"github.com/burmilla/os/cmd/cloudinitexecute\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n\t\"golang.org/x/net/context\"\n)\n\nconst (\n\tca = \"/etc/ssl/certs/ca-certificates.crt\"\n\tcaBase = \"/etc/ssl/certs/ca-certificates.crt.rancher\"\n)\n\nfunc entrypointAction(c *cli.Context) error {\n\tif _, err := os.Stat(\"/host/dev\"); err == nil {\n\t\tcmd := exec.Command(\"mount\", \"--rbind\", \"/host/dev\", \"/dev\")\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Errorf(\"Failed to mount /dev: %v\", err)\n\t\t}\n\t}\n\n\tif err := util.FileCopy(caBase, ca); err != nil && !os.IsNotExist(err) {\n\t\tlog.Error(err)\n\t}\n\n\tcfg := config.LoadConfig()\n\n\tshouldWriteFiles := false\n\tfor _, file := range cfg.WriteFiles {\n\t\tif file.Container != \"\" {\n\t\t\tshouldWriteFiles = true\n\t\t}\n\t}\n\n\tif shouldWriteFiles {\n\t\twriteFiles(cfg)\n\t}\n\n\tsetupCommandSymlinks()\n\n\tif len(os.Args) < 3 {\n\t\treturn nil\n\t}\n\n\tbinary, err := exec.LookPath(os.Args[2])\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn syscall.Exec(binary, os.Args[2:], os.Environ())\n}\n\nfunc writeFiles(cfg *config.CloudConfig) error {\n\tid, err := util.GetCurrentContainerID()\n\tif err != nil {\n\t\treturn err\n\t}\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\treturn err\n\t}\n\tinfo, err := client.ContainerInspect(context.Background(), id)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcloudinitexecute.WriteFiles(cfg, info.Name[1:])\n\treturn nil\n}\n\nfunc setupCommandSymlinks() {\n\tfor _, link := range []symlink{\n\t\t{config.RosBin, \"/usr/bin/autologin\"},\n\t\t{config.RosBin, \"/usr/bin/recovery\"},\n\t\t{config.RosBin, \"/usr/bin/cloud-init-execute\"},\n\t\t{config.RosBin, \"/usr/bin/cloud-init-save\"},\n\t\t{config.RosBin, \"/usr/bin/dockerlaunch\"},\n\t\t{config.RosBin, \"/usr/bin/respawn\"},\n\t\t{config.RosBin, \"/usr/sbin/netconf\"},\n\t\t{config.RosBin, \"/usr/sbin/wait-for-docker\"},\n\t\t{config.RosBin, \"/usr/sbin/poweroff\"},\n\t\t{config.RosBin, \"/usr/sbin/reboot\"},\n\t\t{config.RosBin, \"/usr/sbin/halt\"},\n\t\t{config.RosBin, \"/usr/sbin/shutdown\"},\n\t\t{config.RosBin, \"/sbin/poweroff\"},\n\t\t{config.RosBin, \"/sbin/reboot\"},\n\t\t{config.RosBin, \"/sbin/halt\"},\n\t\t{config.RosBin, \"/sbin/shutdown\"},\n\t} {\n\t\tos.Remove(link.newname)\n\t\tif err := os.Symlink(link.oldname, link.newname); err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n}\n" }, { "path": "cmd/control/env.go", "content": "package control\n\nimport (\n\t\"log\"\n\t\"os\"\n\t\"os/exec\"\n\t\"syscall\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nfunc envAction(c *cli.Context) error {\n\tcfg := config.LoadConfig()\n\n\targs := c.Args()\n\tif len(args) == 0 {\n\t\treturn nil\n\t}\n\tosEnv := os.Environ()\n\n\tenvMap := make(map[string]string, len(cfg.Rancher.Environment)+len(osEnv))\n\tfor k, v := range cfg.Rancher.Environment {\n\t\tenvMap[k] = v\n\t}\n\tfor k, v := range util.KVPairs2Map(osEnv) {\n\t\tenvMap[k] = v\n\t}\n\n\tif cmd, err := exec.LookPath(args[0]); err != nil {\n\t\tlog.Fatal(err)\n\t} else {\n\t\targs[0] = cmd\n\t}\n\tif err := syscall.Exec(args[0], args, util.Map2KVPairs(envMap)); err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/control/install/grub.go", "content": "package install\n\nimport (\n\t\"html/template\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\n\t\"github.com/burmilla/os/pkg/log\"\n)\n\nfunc RunGrub(baseName, device string) error {\n\tlog.Debugf(\"installGrub\")\n\n\t//grub-install --boot-directory=${baseName}/boot ${device}\n\tcmd := exec.Command(\"grub-install\", \"--boot-directory=\"+baseName+\"/boot\", device)\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"%s\", err)\n\t\treturn err\n\t}\n\treturn nil\n}\n\nfunc grubConfig(menu BootVars) error {\n\tlog.Debugf(\"grubConfig\")\n\n\tfiletmpl, err := template.New(\"grub2config\").Parse(`{{define \"grub2menu\"}}menuentry \"{{.Name}}\" {\n set root=(hd0,msdos1)\n linux /{{.bootDir}}vmlinuz-{{.Version}}-rancheros {{.KernelArgs}} {{.Append}}\n initrd /{{.bootDir}}initrd-{{.Version}}-rancheros\n}\n\n{{end}}\nset default=\"0\"\nset timeout=\"{{.Timeout}}\"\n{{if .Fallback}}set fallback={{.Fallback}}{{end}}\n\n{{- range .Entries}}\n{{template \"grub2menu\" .}}\n{{- end}}\n\n`)\n\tif err != nil {\n\t\tlog.Errorf(\"grub2config %s\", err)\n\t\treturn err\n\t}\n\n\tcfgFile := filepath.Join(menu.BaseName, menu.BootDir+\"grub/grub.cfg\")\n\tlog.Debugf(\"grubConfig written to %s\", cfgFile)\n\n\tf, err := os.Create(cfgFile)\n\tif err != nil {\n\t\treturn err\n\t}\n\terr = filetmpl.Execute(f, menu)\n\tif err != nil {\n\t\treturn err\n\t}\n\treturn nil\n}\n\nfunc PvGrubConfig(menu BootVars) error {\n\tlog.Debugf(\"pvGrubConfig\")\n\n\tfiletmpl, err := template.New(\"grublst\").Parse(`{{define \"grubmenu\"}}\ntitle BurmillaOS {{.Version}}-({{.Name}})\nroot (hd0)\nkernel /${bootDir}vmlinuz-{{.Version}}-rancheros {{.KernelArgs}} {{.Append}}\ninitrd /${bootDir}initrd-{{.Version}}-rancheros\n\n{{end}}\ndefault 0\ntimeout {{.Timeout}}\n{{if .Fallback}}fallback {{.Fallback}}{{end}}\nhiddenmenu\n\n{{- range .Entries}}\n{{template \"grubmenu\" .}}\n{{- end}}\n\n`)\n\tif err != nil {\n\t\tlog.Errorf(\"pv grublst: %s\", err)\n\n\t\treturn err\n\t}\n\n\tcfgFile := filepath.Join(menu.BaseName, menu.BootDir+\"grub/menu.lst\")\n\tlog.Debugf(\"grubMenu written to %s\", cfgFile)\n\tf, err := os.Create(cfgFile)\n\tif err != nil {\n\t\tlog.Errorf(\"Create(%s) %s\", cfgFile, err)\n\n\t\treturn err\n\t}\n\terr = filetmpl.Execute(f, menu)\n\tif err != nil {\n\t\tlog.Errorf(\"execute %s\", err)\n\t\treturn err\n\t}\n\treturn nil\n}\n" }, { "path": "cmd/control/install/install.go", "content": "package install\n\nimport (\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n)\n\ntype MenuEntry struct {\n\tName, BootDir, Version, KernelArgs, Append string\n}\ntype BootVars struct {\n\tBaseName, BootDir string\n\tTimeout uint\n\tFallback int\n\tEntries []MenuEntry\n}\n\nfunc MountDevice(baseName, device, partition string, raw bool) (string, string, error) {\n\tlog.Debugf(\"mountdevice %s, raw %v\", partition, raw)\n\n\tif partition == \"\" {\n\t\tif raw {\n\t\t\tlog.Debugf(\"util.Mount (raw) %s, %s\", partition, baseName)\n\n\t\t\tcmd := exec.Command(\"lsblk\", \"-no\", \"pkname\", partition)\n\t\t\tlog.Debugf(\"Run(%v)\", cmd)\n\t\t\tcmd.Stderr = os.Stderr\n\t\t\tdevice := \"\"\n\t\t\t// TODO: out can == \"\" - this is used to \"detect software RAID\" which is terrible\n\t\t\tif out, err := cmd.Output(); err == nil {\n\t\t\t\tdevice = \"/dev/\" + strings.TrimSpace(string(out))\n\t\t\t}\n\n\t\t\tlog.Debugf(\"mountdevice return -> d: %s, p: %s\", device, partition)\n\t\t\treturn device, partition, util.Mount(partition, baseName, \"\", \"\")\n\t\t}\n\n\t\t//rootfs := partition\n\t\t// Don't use ResolveDevice - it can fail, whereas `blkid -L LABEL` works more often\n\n\t\td, _, err := util.Blkid(\"RANCHER_BOOT\")\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"Failed to run blkid: %s\", err)\n\t\t}\n\t\tif d != \"\" {\n\t\t\tpartition = d\n\t\t\tbaseName = filepath.Join(baseName, config.BootDir)\n\t\t} else {\n\t\t\tpartition = GetStatePartition()\n\t\t}\n\t\tcmd := exec.Command(\"lsblk\", \"-no\", \"pkname\", partition)\n\t\tlog.Debugf(\"Run(%v)\", cmd)\n\t\tcmd.Stderr = os.Stderr\n\t\t// TODO: out can == \"\" - this is used to \"detect software RAID\" which is terrible\n\t\tif out, err := cmd.Output(); err == nil {\n\t\t\tdevice = \"/dev/\" + strings.TrimSpace(string(out))\n\t\t}\n\t}\n\tos.MkdirAll(baseName, 0755)\n\tcmd := exec.Command(\"mount\", partition, baseName)\n\t//cmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tlog.Debugf(\"mountdevice return2 -> d: %s, p: %s\", device, partition)\n\treturn device, partition, cmd.Run()\n}\n\nfunc GetStatePartition() string {\n\tcfg := config.LoadConfig()\n\n\tif dev := util.ResolveDevice(cfg.Rancher.State.Dev); dev != \"\" {\n\t\t// try the rancher.state.dev setting\n\t\treturn dev\n\t}\n\td, _, err := util.Blkid(\"RANCHER_STATE\")\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to run blkid: %s\", err)\n\t}\n\treturn d\n}\n\nfunc GetDefaultPartition(device string) string {\n\tif strings.Contains(device, \"nvme\") {\n\t\treturn device + \"p1\"\n\t}\n\treturn device + \"1\"\n}\n" }, { "path": "cmd/control/install/service.go", "content": "package install\n\nimport (\n\t\"io/ioutil\"\n\t\"os\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\t\"github.com/burmilla/os/pkg/util/network\"\n\n\tyaml \"github.com/cloudfoundry-incubator/candiedyaml\"\n)\n\ntype ImageConfig struct {\n\tImage string `yaml:\"image,omitempty\"`\n}\n\nfunc GetCacheImageList(cloudconfig string, oldcfg *config.CloudConfig) []string {\n\tsavedImages := make([]string, 0)\n\tbytes, err := readConfigFile(cloudconfig)\n\tif err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err}).Fatal(\"Failed to read cloud-config\")\n\t\treturn savedImages\n\t}\n\tr := make(map[interface{}]interface{})\n\tif err := yaml.Unmarshal(bytes, &r); err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err}).Fatal(\"Failed to unmarshal cloud-config\")\n\t\treturn savedImages\n\t}\n\tnewcfg := &config.CloudConfig{}\n\tif err := util.Convert(r, newcfg); err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err}).Fatal(\"Failed to convert cloud-config\")\n\t\treturn savedImages\n\t}\n\n\t// services_include\n\tfor key, value := range newcfg.Rancher.ServicesInclude {\n\t\tif value {\n\t\t\tserviceImage := getServiceImage(key, \"\", oldcfg, newcfg)\n\t\t\tif serviceImage != \"\" {\n\t\t\t\tsavedImages = append(savedImages, serviceImage)\n\t\t\t}\n\t\t}\n\t}\n\n\t// console\n\tnewConsole := newcfg.Rancher.Console\n\tif newConsole != \"\" && newConsole != \"default\" {\n\t\tconsoleImage := getServiceImage(newConsole, \"console\", oldcfg, newcfg)\n\t\tif consoleImage != \"\" {\n\t\t\tsavedImages = append(savedImages, consoleImage)\n\t\t}\n\t}\n\n\t// docker engine\n\tnewEngine := newcfg.Rancher.Docker.Engine\n\tif newEngine != \"\" && newEngine != oldcfg.Rancher.Docker.Engine {\n\t\tengineImage := getServiceImage(newEngine, \"docker\", oldcfg, newcfg)\n\t\tif engineImage != \"\" {\n\t\t\tsavedImages = append(savedImages, engineImage)\n\t\t}\n\n\t}\n\n\treturn savedImages\n}\n\nfunc getServiceImage(service, svctype string, oldcfg, newcfg *config.CloudConfig) string {\n\tvar (\n\t\tserviceImage string\n\t\tbytes []byte\n\t\terr error\n\t)\n\tif len(newcfg.Rancher.Repositories.ToArray()) > 0 {\n\t\tbytes, err = network.LoadServiceResource(service, true, newcfg)\n\t} else {\n\t\tbytes, err = network.LoadServiceResource(service, true, oldcfg)\n\t}\n\tif err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err}).Fatal(\"Failed to load service resource\")\n\t\treturn serviceImage\n\t}\n\timageConfig := map[interface{}]ImageConfig{}\n\tif err = yaml.Unmarshal(bytes, &imageConfig); err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err}).Fatal(\"Failed to unmarshal service\")\n\t\treturn serviceImage\n\t}\n\tswitch svctype {\n\tcase \"console\":\n\t\tserviceImage = formatImage(imageConfig[\"console\"].Image, oldcfg, newcfg)\n\tcase \"docker\":\n\t\tserviceImage = formatImage(imageConfig[\"docker\"].Image, oldcfg, newcfg)\n\tdefault:\n\t\tserviceImage = formatImage(imageConfig[service].Image, oldcfg, newcfg)\n\t}\n\n\treturn serviceImage\n}\n\nfunc RunCacheScript(partition string, images []string) error {\n\treturn util.RunScript(\"/scripts/cache-services.sh\", partition, strings.Join(images, \" \"))\n}\n\nfunc readConfigFile(file string) ([]byte, error) {\n\tcontent, err := ioutil.ReadFile(file)\n\tif err != nil {\n\t\tif os.IsNotExist(err) {\n\t\t\terr = nil\n\t\t\tcontent = []byte{}\n\t\t} else {\n\t\t\treturn nil, err\n\t\t}\n\t}\n\treturn content, err\n}\n\nfunc formatImage(image string, oldcfg, newcfg *config.CloudConfig) string {\n\tregistryDomain := newcfg.Rancher.Environment[\"REGISTRY_DOMAIN\"]\n\tif registryDomain == \"\" {\n\t\tregistryDomain = oldcfg.Rancher.Environment[\"REGISTRY_DOMAIN\"]\n\t}\n\timage = strings.Replace(image, \"${REGISTRY_DOMAIN}\", registryDomain, -1)\n\n\timage = strings.Replace(image, \"${SUFFIX}\", config.Suffix, -1)\n\n\treturn image\n}\n" }, { "path": "cmd/control/install/syslinux.go", "content": "package install\n\nimport (\n\t\"bufio\"\n\t\"bytes\"\n\t\"html/template\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"path/filepath\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/pkg/log\"\n)\n\nfunc syslinuxConfig(menu BootVars) error {\n\tlog.Debugf(\"syslinuxConfig\")\n\n\tfiletmpl, err := template.New(\"syslinuxconfig\").Parse(`{{define \"syslinuxmenu\"}}\nLABEL {{.Name}}\n LINUX ../vmlinuz-{{.Version}}-rancheros\n APPEND {{.KernelArgs}} {{.Append}}\n INITRD ../initrd-{{.Version}}-rancheros\n{{end}}\nTIMEOUT 20 #2 seconds\nDEFAULT BurmillaOS-current\n\n{{- range .Entries}}\n{{template \"syslinuxmenu\" .}}\n{{- end}}\n\n`)\n\tif err != nil {\n\t\tlog.Errorf(\"syslinuxconfig %s\", err)\n\t\treturn err\n\t}\n\n\tcfgFile := filepath.Join(menu.BaseName, menu.BootDir+\"syslinux/syslinux.cfg\")\n\tlog.Debugf(\"syslinuxConfig written to %s\", cfgFile)\n\tf, err := os.Create(cfgFile)\n\tif err != nil {\n\t\tlog.Errorf(\"Create(%s) %s\", cfgFile, err)\n\t\treturn err\n\t}\n\terr = filetmpl.Execute(f, menu)\n\tif err != nil {\n\t\treturn err\n\t}\n\treturn nil\n}\n\nfunc ReadGlobalCfg(globalCfg string) (string, error) {\n\tappend := \"\"\n\tbuf, err := ioutil.ReadFile(globalCfg)\n\tif err != nil {\n\t\treturn append, err\n\t}\n\n\ts := bufio.NewScanner(bytes.NewReader(buf))\n\tfor s.Scan() {\n\t\tline := strings.TrimSpace(s.Text())\n\t\tif strings.HasPrefix(line, \"APPEND\") {\n\t\t\tappend = strings.TrimSpace(strings.TrimPrefix(line, \"APPEND\"))\n\t\t}\n\t}\n\treturn append, nil\n}\n\nfunc ReadSyslinuxCfg(currentCfg string) (string, string, error) {\n\tvmlinuzFile := \"\"\n\tinitrdFile := \"\"\n\t// Need to parse currentCfg for the lines:\n\t// KERNEL ../vmlinuz-4.9.18-rancher^M\n\t// INITRD ../initrd-41e02e6-dirty^M\n\tbuf, err := ioutil.ReadFile(currentCfg)\n\tif err != nil {\n\t\treturn vmlinuzFile, initrdFile, err\n\t}\n\n\tDIST := filepath.Dir(currentCfg)\n\n\ts := bufio.NewScanner(bytes.NewReader(buf))\n\tfor s.Scan() {\n\t\tline := strings.TrimSpace(s.Text())\n\t\tif strings.HasPrefix(line, \"KERNEL\") {\n\t\t\tvmlinuzFile = strings.TrimSpace(strings.TrimPrefix(line, \"KERNEL\"))\n\t\t\tvmlinuzFile = filepath.Join(DIST, filepath.Base(vmlinuzFile))\n\t\t}\n\t\tif strings.HasPrefix(line, \"INITRD\") {\n\t\t\tinitrdFile = strings.TrimSpace(strings.TrimPrefix(line, \"INITRD\"))\n\t\t\tinitrdFile = filepath.Join(DIST, filepath.Base(initrdFile))\n\t\t}\n\t}\n\treturn vmlinuzFile, initrdFile, err\n}\n" }, { "path": "cmd/control/install.go", "content": "package control\n\nimport (\n\t\"bufio\"\n\t\"bytes\"\n\t\"crypto/md5\"\n\t\"fmt\"\n\t\"io\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\t\"runtime\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/cmd/control/install\"\n\t\"github.com/burmilla/os/cmd/power\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/dfs\" // TODO: move CopyFile into util or something.\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n\t\"github.com/pkg/errors\"\n)\n\nvar installCommand = cli.Command{\n\tName: \"install\",\n\tUsage: \"install BurmillaOS to disk\",\n\tHideHelp: true,\n\tAction: installAction,\n\tFlags: []cli.Flag{\n\t\tcli.StringFlag{\n\t\t\t// TODO: need to validate ? -i burmilla/os:v0.3.1 just sat there.\n\t\t\tName: \"image, i\",\n\t\t\tUsage: `install from a certain image (e.g., 'rancher/os:v0.7.0')\n\t\t\t\t\t\t\tuse 'ros os list' to see what versions are available.`,\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"install-type, t\",\n\t\t\tUsage: `generic: (Default) Creates 1 ext4 partition and installs BurmillaOS (syslinux)\n amazon-ebs: Installs BurmillaOS and sets up PV-GRUB\n gptsyslinux: partition and format disk (gpt), then install BurmillaOS and setup Syslinux\n `,\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"cloud-config, c\",\n\t\t\tUsage: \"cloud-config yml file - needed for SSH authorized keys\",\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"device, d\",\n\t\t\tUsage: \"storage device\",\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"partition, p\",\n\t\t\tUsage: \"partition to install to\",\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"statedir\",\n\t\t\tUsage: \"install to rancher.state.directory\",\n\t\t},\n\t\tcli.BoolFlag{\n\t\t\tName: \"force, f\",\n\t\t\tUsage: \"[ DANGEROUS! Data loss can happen ] partition/format without prompting\",\n\t\t},\n\t\tcli.BoolFlag{\n\t\t\tName: \"no-reboot\",\n\t\t\tUsage: \"do not reboot after install\",\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"append, a\",\n\t\t\tUsage: \"append additional kernel parameters\",\n\t\t},\n\t\tcli.StringFlag{\n\t\t\tName: \"rollback, r\",\n\t\t\tUsage: \"rollback version\",\n\t\t\tHidden: true,\n\t\t},\n\t\tcli.BoolFlag{\n\t\t\tName: \"isoinstallerloaded\",\n\t\t\tUsage: \"INTERNAL use only: mount the iso to get kernel and initrd\",\n\t\t\tHidden: true,\n\t\t},\n\t\tcli.BoolFlag{\n\t\t\tName: \"kexec, k\",\n\t\t\tUsage: \"reboot using kexec\",\n\t\t},\n\t\tcli.BoolFlag{\n\t\t\tName: \"save, s\",\n\t\t\tUsage: \"save services and images for next booting\",\n\t\t},\n\t\tcli.BoolFlag{\n\t\t\tName: \"debug\",\n\t\t\tUsage: \"Run installer with debug output\",\n\t\t},\n\t},\n}\n\nfunc installAction(c *cli.Context) error {\n\tlog.InitLogger()\n\tdebug := c.Bool(\"debug\")\n\tif debug {\n\t\tlog.Info(\"Log level is debug\")\n\t\toriginalLevel := log.GetLevel()\n\t\tdefer log.SetLevel(originalLevel)\n\t\tlog.SetLevel(log.DebugLevel)\n\t}\n\n\tif runtime.GOARCH != \"amd64\" {\n\t\tlog.Fatalf(\"ros install / upgrade only supported on 'amd64', not '%s'\", runtime.GOARCH)\n\t}\n\n\tif c.Args().Present() {\n\t\tlog.Fatalf(\"invalid arguments %v\", c.Args())\n\t}\n\n\tkappend := strings.TrimSpace(c.String(\"append\"))\n\tforce := c.Bool(\"force\")\n\tkexec := c.Bool(\"kexec\")\n\treboot := !c.Bool(\"no-reboot\")\n\tisoinstallerloaded := c.Bool(\"isoinstallerloaded\")\n\n\timage := c.String(\"image\")\n\tcfg := config.LoadConfig()\n\tif image == \"\" {\n\t\timage = fmt.Sprintf(\"%s:%s%s\",\n\t\t\tcfg.Rancher.Upgrade.Image,\n\t\t\tconfig.Version,\n\t\t\tconfig.Suffix)\n\t\timage = formatImage(image, cfg)\n\t}\n\n\tinstallType := c.String(\"install-type\")\n\tif installType == \"\" {\n\t\tlog.Info(\"No install type specified...defaulting to generic\")\n\t\tinstallType = \"generic\"\n\t}\n\tif installType == \"rancher-upgrade\" ||\n\t\tinstallType == \"upgrade\" {\n\t\tinstallType = \"upgrade\" // rancher-upgrade is redundant!\n\t\tforce = true // the os.go upgrade code already asks\n\t\treboot = false\n\t\tisoinstallerloaded = true // OMG this flag is aweful - kill it with fire\n\t}\n\tdevice := c.String(\"device\")\n\tpartition := c.String(\"partition\")\n\tstatedir := c.String(\"statedir\")\n\tif statedir != \"\" && installType != \"noformat\" {\n\t\tlog.Fatalf(\"--statedir %s requires --type noformat\", statedir)\n\t}\n\tif installType != \"noformat\" &&\n\t\tinstallType != \"raid\" &&\n\t\tinstallType != \"bootstrap\" &&\n\t\tinstallType != \"upgrade\" {\n\t\t// These can use RANCHER_BOOT or RANCHER_STATE labels..\n\t\tif device == \"\" {\n\t\t\tlog.Fatal(\"Can not proceed without -d specified\")\n\t\t}\n\t}\n\n\tcloudConfig := c.String(\"cloud-config\")\n\tif cloudConfig == \"\" {\n\t\tif installType != \"upgrade\" {\n\t\t\t// TODO: I wonder if its plausible to merge a new cloud-config into an existing one on upgrade - so for now, i'm only turning off the warning\n\t\t\tlog.Warn(\"Cloud-config not provided: you might need to provide cloud-config on boot with ssh_authorized_keys\")\n\t\t}\n\t} else {\n\t\tos.MkdirAll(\"/opt\", 0755)\n\t\tuc := \"/opt/user_config.yml\"\n\t\tif strings.HasPrefix(cloudConfig, \"http://\") || strings.HasPrefix(cloudConfig, \"https://\") {\n\t\t\tif err := util.HTTPDownloadToFile(cloudConfig, uc); err != nil {\n\t\t\t\tlog.WithFields(log.Fields{\"cloudConfig\": cloudConfig, \"error\": err}).Fatal(\"Failed to http get cloud-config\")\n\t\t\t}\n\t\t} else {\n\t\t\tif err := util.FileCopy(cloudConfig, uc); err != nil {\n\t\t\t\tlog.WithFields(log.Fields{\"cloudConfig\": cloudConfig, \"error\": err}).Fatal(\"Failed to copy cloud-config\")\n\t\t\t}\n\t\t}\n\t\tcloudConfig = uc\n\t}\n\n\tsavedImages := []string{}\n\tif c.Bool(\"save\") && cloudConfig != \"\" && installType != \"upgrade\" {\n\t\tsavedImages = install.GetCacheImageList(cloudConfig, cfg)\n\t\tlog.Debugf(\"Will cache these images: %s\", savedImages)\n\t}\n\n\tif err := runInstall(image, installType, cloudConfig, device, partition, statedir, kappend, force, kexec, isoinstallerloaded, debug, savedImages); err != nil {\n\t\tlog.WithFields(log.Fields{\"err\": err}).Fatal(\"Failed to run install\")\n\t\treturn err\n\t}\n\n\tif !kexec && reboot && (force || yes(\"Continue with reboot\")) {\n\t\tlog.Info(\"Rebooting\")\n\t\tpower.Reboot()\n\t}\n\n\treturn nil\n}\n\nfunc runInstall(image, installType, cloudConfig, device, partition, statedir, kappend string, force, kexec, isoinstallerloaded, debug bool, savedImages []string) error {\n\tfmt.Printf(\"Installing from %s\\n\", image)\n\n\tif !force {\n\t\tif util.IsRunningInTty() && !yes(\"Continue\") {\n\t\t\tlog.Infof(\"Not continuing with installation due to user not saying 'yes'\")\n\t\t\tos.Exit(1)\n\t\t}\n\t}\n\n\tuseIso := false\n\t// --isoinstallerloaded is used if the ros has created the installer container from and image that was on the booted iso\n\tif !isoinstallerloaded {\n\t\tlog.Infof(\"start !isoinstallerloaded\")\n\n\t\tif _, err := os.Stat(\"/dist/initrd-\" + config.Version); os.IsNotExist(err) {\n\t\t\tdeviceName, deviceType, err := getBootIso()\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"Failed to get boot iso: %v\", err)\n\t\t\t\tfmt.Println(\"There is no boot iso drive, terminate the task\")\n\t\t\t\treturn err\n\t\t\t}\n\t\t\tif err = mountBootIso(deviceName, deviceType); err != nil {\n\t\t\t\tlog.Debugf(\"Failed to mountBootIso: %v\", err)\n\t\t\t} else {\n\t\t\t\tlog.Infof(\"trying to load /bootiso/rancheros/installer.tar.gz\")\n\t\t\t\tif _, err := os.Stat(\"/bootiso/rancheros/\"); err == nil {\n\t\t\t\t\tcmd := exec.Command(\"system-docker\", \"load\", \"-i\", \"/bootiso/rancheros/installer.tar.gz\")\n\t\t\t\t\tcmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\t\t\t\t\tif err := cmd.Run(); err != nil {\n\t\t\t\t\t\tlog.Infof(\"failed to load images from /bootiso/rancheros: %v\", err)\n\t\t\t\t\t} else {\n\t\t\t\t\t\tlog.Infof(\"Loaded images from /bootiso/rancheros/installer.tar.gz\")\n\n\t\t\t\t\t\t//TODO: add if os-installer:latest exists - we might have loaded a full installer?\n\t\t\t\t\t\tuseIso = true\n\t\t\t\t\t\t// now use the installer image\n\t\t\t\t\t\tcfg := config.LoadConfig()\n\n\t\t\t\t\t\tif image == cfg.Rancher.Upgrade.Image+\":\"+config.Version+config.Suffix {\n\t\t\t\t\t\t\t// TODO: fix the fullinstaller Dockerfile to use the ${VERSION}${SUFFIX}\n\t\t\t\t\t\t\timage = cfg.Rancher.Upgrade.Image + \"-installer\" + \":latest\"\n\t\t\t\t\t\t}\n\t\t\t\t\t}\n\t\t\t\t}\n\t\t\t\t// TODO: also poke around looking for the /boot/vmlinuz and initrd...\n\t\t\t}\n\n\t\t\tlog.Infof(\"starting installer container for %s (new)\", image)\n\t\t\tinstallerCmd := []string{\n\t\t\t\t\"run\", \"--rm\", \"--net=host\", \"--privileged\",\n\t\t\t\t// bind mount host fs to access its ros, vmlinuz, initrd and /dev (udev isn't running in container)\n\t\t\t\t\"-v\", \"/:/host\",\n\t\t\t\t\"--volumes-from=all-volumes\",\n\t\t\t\timage,\n\t\t\t\t//\t\t\t\t\"install\",\n\t\t\t\t\"-t\", installType,\n\t\t\t\t\"-d\", device,\n\t\t\t\t\"-i\", image, // TODO: this isn't used - I'm just using it to over-ride the defaulting\n\t\t\t}\n\t\t\t// Need to call the inner container with force - the outer one does the \"are you sure\"\n\t\t\tinstallerCmd = append(installerCmd, \"-f\")\n\t\t\t// The outer container does the reboot (if needed)\n\t\t\tinstallerCmd = append(installerCmd, \"--no-reboot\")\n\t\t\tif cloudConfig != \"\" {\n\t\t\t\tinstallerCmd = append(installerCmd, \"-c\", cloudConfig)\n\t\t\t}\n\t\t\tif kappend != \"\" {\n\t\t\t\tinstallerCmd = append(installerCmd, \"-a\", kappend)\n\t\t\t}\n\t\t\tif useIso {\n\t\t\t\tinstallerCmd = append(installerCmd, \"--isoinstallerloaded=1\")\n\t\t\t}\n\t\t\tif kexec {\n\t\t\t\tinstallerCmd = append(installerCmd, \"--kexec\")\n\t\t\t}\n\t\t\tif debug {\n\t\t\t\tinstallerCmd = append(installerCmd, \"--debug\")\n\t\t\t}\n\t\t\tif partition != \"\" {\n\t\t\t\tinstallerCmd = append(installerCmd, \"--partition\", partition)\n\t\t\t}\n\t\t\tif statedir != \"\" {\n\t\t\t\tinstallerCmd = append(installerCmd, \"--statedir\", statedir)\n\t\t\t}\n\t\t\tif len(savedImages) > 0 {\n\t\t\t\tinstallerCmd = append(installerCmd, \"--save\")\n\t\t\t}\n\n\t\t\t// TODO: mount at /mnt for shared mount?\n\t\t\tif useIso {\n\t\t\t\tutil.Unmount(\"/bootiso\")\n\t\t\t}\n\t\t\tcmd := exec.Command(\"system-docker\", installerCmd...)\n\t\t\tlog.Debugf(\"Run(%v)\", cmd)\n\t\t\tcmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\n\t\t\treturn cmd.Run()\n\t\t}\n\t}\n\n\tlog.Debugf(\"running installation\")\n\n\tif partition == \"\" {\n\t\tif installType == \"generic\" ||\n\t\t\tinstallType == \"syslinux\" ||\n\t\t\tinstallType == \"gptsyslinux\" {\n\t\t\tdiskType := \"msdos\"\n\t\t\tif installType == \"gptsyslinux\" {\n\t\t\t\tdiskType = \"gpt\"\n\t\t\t}\n\t\t\tlog.Debugf(\"running setDiskpartitions\")\n\t\t\terr := setDiskpartitions(device, diskType)\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"error setDiskpartitions %s\", err)\n\t\t\t\treturn err\n\t\t\t}\n\t\t\t// use the bind mounted host filesystem to get access to the /dev/vda1 device that udev on the host sets up (TODO: can we run a udevd inside the container? `mknod b 253 1 /dev/vda1` doesn't work)\n\t\t\tdevice = \"/host\" + device\n\t\t\t//# TODO: Change this to a number so that users can specify.\n\t\t\t//# Will need to make it so that our builds and packer APIs remain consistent.\n\t\t\tpartition = install.GetDefaultPartition(device)\n\t\t}\n\t}\n\n\tif installType == \"upgrade\" {\n\t\tisoinstallerloaded = false\n\t}\n\n\tif isoinstallerloaded {\n\t\tlog.Debugf(\"running isoinstallerloaded...\")\n\t\t// TODO: detect if its not mounted and then optionally mount?\n\t\tdeviceName, deviceType, err := getBootIso()\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"Failed to get boot iso: %v\", err)\n\t\t\tfmt.Println(\"There is no boot iso drive, terminate the task\")\n\t\t\treturn err\n\t\t}\n\t\tif err := mountBootIso(deviceName, deviceType); err != nil {\n\t\t\tlog.Errorf(\"error mountBootIso %s\", err)\n\t\t\t//return err\n\t\t}\n\t}\n\n\terr := layDownOS(image, installType, cloudConfig, device, partition, statedir, kappend, kexec)\n\tif err != nil {\n\t\tlog.Errorf(\"error layDownOS %s\", err)\n\t\treturn err\n\t}\n\n\tif len(savedImages) > 0 {\n\t\treturn install.RunCacheScript(partition, savedImages)\n\t}\n\n\treturn nil\n}\n\nfunc getDeviceByLabel(label string) (string, string) {\n\td, t, err := util.Blkid(label)\n\tif err != nil {\n\t\tlog.Warnf(\"Failed to run blkid for %s\", label)\n\t\treturn \"\", \"\"\n\t}\n\treturn d, t\n}\n\nfunc getBootIso() (string, string, error) {\n\tdeviceName := \"/dev/sr0\"\n\tdeviceType := \"iso9660\"\n\n\t// Our ISO LABEL is RancherOS\n\t// But some tools(like rufus) will change LABEL to RANCHEROS\n\tfor _, label := range []string{\"RancherOS\", \"RANCHEROS\"} {\n\t\td, t := getDeviceByLabel(label)\n\t\tif d != \"\" {\n\t\t\tdeviceName = d\n\t\t\tdeviceType = t\n\t\t\tcontinue\n\t\t}\n\t}\n\n\t// Check the sr deive if exist\n\tif _, err := os.Stat(deviceName); os.IsNotExist(err) {\n\t\treturn \"\", \"\", err\n\t}\n\n\treturn deviceName, deviceType, nil\n}\n\nfunc mountBootIso(deviceName, deviceType string) error {\n\tmountsFile, err := os.Open(\"/proc/mounts\")\n\tif err != nil {\n\t\treturn errors.Wrap(err, \"Failed to read /proc/mounts\")\n\t}\n\tdefer mountsFile.Close()\n\n\tif partitionMounted(deviceName, mountsFile) {\n\t\treturn nil\n\t}\n\n\tos.MkdirAll(\"/bootiso\", 0755)\n\tcmd := exec.Command(\"mount\", \"-t\", deviceType, deviceName, \"/bootiso\")\n\tlog.Debugf(\"mount (%#v)\", cmd)\n\n\tvar outBuf, errBuf bytes.Buffer\n\tcmd.Stdout = &outBuf\n\tcmd.Stderr = &errBuf\n\terr = cmd.Run()\n\tif err != nil {\n\t\treturn errors.Wrapf(err, \"Tried and failed to mount %s: stderr output: %s\", deviceName, errBuf.String())\n\t}\n\tlog.Debugf(\"Mounted %s, output: %s\", deviceName, outBuf.String())\n\treturn nil\n}\n\nfunc layDownOS(image, installType, cloudConfig, device, partition, statedir, kappend string, kexec bool) error {\n\t// ENV == installType\n\t//[[ \"$ARCH\" == \"arm\" && \"$ENV\" != \"upgrade\" ]] && ENV=arm\n\n\t// image == burmilla/os:v0.7.0_arm\n\t// TODO: remove the _arm suffix (but watch out, its not always there..)\n\tVERSION := image[strings.Index(image, \":\")+1:]\n\n\tvar FILES []string\n\tDIST := \"/dist\" //${DIST:-/dist}\n\t//cloudConfig := SCRIPTS_DIR + \"/conf/empty.yml\" //${cloudConfig:-\"${SCRIPTS_DIR}/conf/empty.yml\"}\n\tCONSOLE := \"tty0\"\n\tbaseName := \"/mnt/new_img\"\n\tkernelArgs := \"printk.devkmsg=on rancher.state.dev=LABEL=RANCHER_STATE rancher.state.wait transparent_hugepage=madvise iommu=pt intel_iommu=off scsi_mod.use_blk_mq=1 apparmor=1 security=apparmor panic=10\" // console=\"+CONSOLE\n\tif statedir != \"\" {\n\t\tkernelArgs = kernelArgs + \" rancher.state.directory=\" + statedir\n\t}\n\n\t// unmount on trap\n\tdefer util.Unmount(baseName)\n\n\tdiskType := \"msdos\"\n\tif installType == \"gptsyslinux\" {\n\t\tdiskType = \"gpt\"\n\t}\n\n\tswitch installType {\n\tcase \"syslinux\":\n\t\tfallthrough\n\tcase \"gptsyslinux\":\n\t\tfallthrough\n\tcase \"generic\":\n\t\tlog.Debugf(\"formatAndMount\")\n\t\tvar err error\n\t\tdevice, _, err = formatAndMount(baseName, device, partition)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"formatAndMount %s\", err)\n\t\t\treturn err\n\t\t}\n\t\terr = installSyslinux(device, baseName, diskType)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"installSyslinux %s\", err)\n\t\t\treturn err\n\t\t}\n\t\terr = seedData(baseName, cloudConfig, FILES)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"seedData %s\", err)\n\t\t\treturn err\n\t\t}\n\tcase \"arm\":\n\t\tvar err error\n\t\t_, _, err = formatAndMount(baseName, device, partition)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tseedData(baseName, cloudConfig, FILES)\n\tcase \"amazon-ebs-pv\":\n\t\tfallthrough\n\tcase \"amazon-ebs-hvm\":\n\t\tCONSOLE = \"ttyS0\"\n\t\tvar err error\n\t\tdevice, _, err = formatAndMount(baseName, device, partition)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif installType == \"amazon-ebs-hvm\" {\n\t\t\tinstallSyslinux(device, baseName, diskType)\n\t\t}\n\t\t//# AWS Networking recommends disabling.\n\t\tseedData(baseName, cloudConfig, FILES)\n\tcase \"googlecompute\":\n\t\tCONSOLE = \"ttyS0\"\n\t\tvar err error\n\t\tdevice, _, err = formatAndMount(baseName, device, partition)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tinstallSyslinux(device, baseName, diskType)\n\t\tseedData(baseName, cloudConfig, FILES)\n\tcase \"noformat\":\n\t\tvar err error\n\t\tdevice, _, err = install.MountDevice(baseName, device, partition, false)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tinstallSyslinux(device, baseName, diskType)\n\t\tif err := os.MkdirAll(filepath.Join(baseName, statedir), 0755); err != nil {\n\t\t\treturn err\n\t\t}\n\t\terr = seedData(baseName, cloudConfig, FILES)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"seedData %s\", err)\n\t\t\treturn err\n\t\t}\n\tcase \"raid\":\n\t\tvar err error\n\t\tdevice, _, err = install.MountDevice(baseName, device, partition, false)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tinstallSyslinux(device, baseName, diskType)\n\tcase \"bootstrap\":\n\t\tCONSOLE = \"ttyS0\"\n\t\tvar err error\n\t\t_, _, err = install.MountDevice(baseName, device, partition, true)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tkernelArgs = kernelArgs + \" rancher.cloud_init.datasources=[ec2,gce]\"\n\tcase \"rancher-upgrade\":\n\t\tinstallType = \"upgrade\" // rancher-upgrade is redundant\n\t\tfallthrough\n\tcase \"upgrade\":\n\t\tvar err error\n\t\tdevice, _, err = install.MountDevice(baseName, device, partition, false)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tlog.Debugf(\"upgrading - %s, %s, %s\", device, baseName, diskType)\n\t\t// TODO: detect pv-grub, and don't kill it with syslinux\n\t\tupgradeBootloader(device, baseName, diskType)\n\tdefault:\n\t\treturn fmt.Errorf(\"unexpected install type %s\", installType)\n\t}\n\tkernelArgs = kernelArgs + \" console=\" + CONSOLE\n\n\tif kappend == \"\" {\n\t\tpreservedAppend, _ := ioutil.ReadFile(filepath.Join(baseName, config.BootDir, \"append\"))\n\t\tkappend = string(preservedAppend)\n\t} else {\n\t\tioutil.WriteFile(filepath.Join(baseName, config.BootDir, \"append\"), []byte(kappend), 0644)\n\t}\n\n\tif installType == \"amazon-ebs-pv\" {\n\t\tmenu := install.BootVars{\n\t\t\tBaseName: baseName,\n\t\t\tBootDir: config.BootDir,\n\t\t\tTimeout: 0,\n\t\t\tFallback: 0, // need to be conditional on there being a 'rollback'?\n\t\t\tEntries: []install.MenuEntry{\n\t\t\t\tinstall.MenuEntry{\n\t\t\t\t\tName: \"BurmillaOS-current\",\n\t\t\t\t\tBootDir: config.BootDir,\n\t\t\t\t\tVersion: VERSION,\n\t\t\t\t\tKernelArgs: kernelArgs,\n\t\t\t\t\tAppend: kappend,\n\t\t\t\t},\n\t\t\t},\n\t\t}\n\t\tinstall.PvGrubConfig(menu)\n\t}\n\tlog.Debugf(\"installRancher\")\n\t_, err := installRancher(baseName, VERSION, DIST, kernelArgs+\" \"+kappend)\n\tif err != nil {\n\t\tlog.Errorf(\"%s\", err)\n\t\treturn err\n\t}\n\tlog.Debugf(\"installRancher done\")\n\n\tif kexec {\n\t\tpower.Kexec(false, filepath.Join(baseName, config.BootDir), kernelArgs+\" \"+kappend)\n\t}\n\n\treturn nil\n}\n\n// files is an array of 'sourcefile:destination' - but i've not seen any examples of it being used.\nfunc seedData(baseName, cloudData string, files []string) error {\n\tlog.Debugf(\"seedData\")\n\t_, err := os.Stat(baseName)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tstateSeedDir := \"state_seed\"\n\tcloudConfigBase := \"/var/lib/rancher/conf/cloud-config.d\"\n\tcloudConfigDir := \"\"\n\n\t// If there is a separate boot partition, cloud-config should be written to RANCHER_STATE partition.\n\tbootPartition, _, err := util.Blkid(\"RANCHER_BOOT\")\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to run blkid: %s\", err)\n\t}\n\tif bootPartition != \"\" {\n\t\tstateSeedFullPath := filepath.Join(baseName, stateSeedDir)\n\t\tif err = os.MkdirAll(stateSeedFullPath, 0700); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tdefer util.Unmount(stateSeedFullPath)\n\n\t\tstatePartition := install.GetStatePartition()\n\t\tcmd := exec.Command(\"mount\", statePartition, stateSeedFullPath)\n\t\t//cmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\t\tlog.Debugf(\"seedData: mount %s to %s\", statePartition, stateSeedFullPath)\n\t\tif err = cmd.Run(); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tcloudConfigDir = filepath.Join(baseName, stateSeedDir, cloudConfigBase)\n\t} else {\n\t\tcloudConfigDir = filepath.Join(baseName, cloudConfigBase)\n\t}\n\n\tif err = os.MkdirAll(cloudConfigDir, 0700); err != nil {\n\t\treturn err\n\t}\n\n\tif !strings.HasSuffix(cloudData, \"empty.yml\") {\n\t\tif err = dfs.CopyFile(cloudData, cloudConfigDir, filepath.Base(cloudData)); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tfor _, f := range files {\n\t\te := strings.Split(f, \":\")\n\t\tif err = dfs.CopyFile(e[0], baseName, e[1]); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\treturn nil\n}\n\n// set-disk-partitions is called with device == **/dev/sda**\nfunc setDiskpartitions(device, diskType string) error {\n\tlog.Debugf(\"setDiskpartitions\")\n\n\td := strings.Split(device, \"/\")\n\tif len(d) != 3 {\n\t\treturn fmt.Errorf(\"bad device name (%s)\", device)\n\t}\n\tdeviceName := d[2]\n\n\tfile, err := os.Open(\"/proc/partitions\")\n\tif err != nil {\n\t\tlog.Debugf(\"failed to read /proc/partitions %s\", err)\n\t\treturn err\n\t}\n\tdefer file.Close()\n\n\texists := false\n\thaspartitions := false\n\tscanner := bufio.NewScanner(file)\n\tfor scanner.Scan() {\n\t\tstr := scanner.Text()\n\t\tlast := strings.LastIndex(str, \" \")\n\n\t\tif last > -1 {\n\t\t\tdev := str[last+1:]\n\n\t\t\tif strings.HasPrefix(dev, deviceName) {\n\t\t\t\tif dev == deviceName {\n\t\t\t\t\texists = true\n\t\t\t\t} else {\n\t\t\t\t\thaspartitions = true\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\t}\n\tif !exists {\n\t\treturn fmt.Errorf(\"disk %s not found: %s\", device, err)\n\t}\n\tif haspartitions {\n\t\tlog.Debugf(\"device %s already partitioned - checking if any are mounted\", device)\n\t\tfile, err := os.Open(\"/proc/mounts\")\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"failed to read /proc/mounts %s\", err)\n\t\t\treturn err\n\t\t}\n\t\tdefer file.Close()\n\t\tif partitionMounted(device, file) {\n\t\t\terr = fmt.Errorf(\"partition %s mounted, cannot repartition\", device)\n\t\t\tlog.Errorf(\"%s\", err)\n\t\t\treturn err\n\t\t}\n\n\t\tcmd := exec.Command(\"system-docker\", \"ps\", \"-q\")\n\t\tvar outb bytes.Buffer\n\t\tcmd.Stdout = &outb\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Printf(\"ps error: %s\", err)\n\t\t\treturn err\n\t\t}\n\t\tfor _, image := range strings.Split(outb.String(), \"\\n\") {\n\t\t\tif image == \"\" {\n\t\t\t\tcontinue\n\t\t\t}\n\t\t\tr, w := io.Pipe()\n\t\t\tgo func() {\n\t\t\t\t// TODO: consider a timeout\n\t\t\t\t// TODO:some of these containers don't have cat / shell\n\t\t\t\tcmd := exec.Command(\"system-docker\", \"exec\", image, \"cat /proc/mount\")\n\t\t\t\tcmd.Stdout = w\n\t\t\t\tif err := cmd.Run(); err != nil {\n\t\t\t\t\tlog.Debugf(\"%s cat %s\", image, err)\n\t\t\t\t}\n\t\t\t\tw.Close()\n\t\t\t}()\n\t\t\tif partitionMounted(device, r) {\n\t\t\t\terr = fmt.Errorf(\"partition %s mounted in %s, cannot repartition\", device, image)\n\t\t\t\tlog.Errorf(\"k? %s\", err)\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\t}\n\t//do it!\n\tlog.Debugf(\"running dd device: %s\", device)\n\tcmd := exec.Command(\"dd\", \"if=/dev/zero\", \"of=\"+device, \"bs=512\", \"count=2048\")\n\t//cmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"dd error %s\", err)\n\t\treturn err\n\t}\n\tlog.Debugf(\"running partprobe: %s\", device)\n\tcmd = exec.Command(\"partprobe\", device)\n\t//cmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"Failed to partprobe device %s: %v\", device, err)\n\t\treturn err\n\t}\n\n\tlog.Debugf(\"making single RANCHER_STATE partition, device: %s\", device)\n\tcmd = exec.Command(\"parted\", \"-s\", \"-a\", \"optimal\", device,\n\t\t\"mklabel \"+diskType, \"--\",\n\t\t\"mkpart primary ext4 1 -1\")\n\tcmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"Failed to parted device %s: %v\", device, err)\n\t\treturn err\n\t}\n\treturn setBootable(device, diskType)\n}\n\nfunc partitionMounted(device string, file io.Reader) bool {\n\tscanner := bufio.NewScanner(file)\n\tfor scanner.Scan() {\n\t\tstr := scanner.Text()\n\t\t// /dev/sdb1 /data ext4 rw,relatime,errors=remount-ro,data=ordered 0 0\n\t\tele := strings.Split(str, \" \")\n\t\tif len(ele) > 5 {\n\t\t\tif strings.HasPrefix(ele[0], device) {\n\t\t\t\treturn true\n\t\t\t}\n\t\t}\n\t\tif err := scanner.Err(); err != nil {\n\t\t\tlog.Errorf(\"scanner %s\", err)\n\t\t\treturn false\n\t\t}\n\t}\n\treturn false\n}\n\nfunc formatdevice(device, partition string) error {\n\tlog.Debugf(\"formatdevice %s\", partition)\n\n\t//mkfs.ext4 -F -i 4096 -L RANCHER_STATE ${partition}\n\t// -O ^64bit: for syslinux: http://www.syslinux.org/wiki/index.php?title=Filesystem#ext\n\tcmd := exec.Command(\"mkfs.ext4\", \"-F\", \"-i\", \"4096\", \"-O\", \"^64bit\", \"-L\", \"RANCHER_STATE\", partition)\n\tlog.Debugf(\"Run(%v)\", cmd)\n\tcmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"mkfs.ext4: %s\", err)\n\t\treturn err\n\t}\n\treturn nil\n}\n\nfunc formatAndMount(baseName, device, partition string) (string, string, error) {\n\tlog.Debugf(\"formatAndMount\")\n\n\terr := formatdevice(device, partition)\n\tif err != nil {\n\t\tlog.Errorf(\"formatdevice %s\", err)\n\t\treturn device, partition, err\n\t}\n\tdevice, partition, err = install.MountDevice(baseName, device, partition, false)\n\tif err != nil {\n\t\tlog.Errorf(\"mountdevice %s\", err)\n\t\treturn device, partition, err\n\t}\n\treturn device, partition, nil\n}\n\nfunc setBootable(device, diskType string) error {\n\t// TODO make conditional - if there is a bootable device already, don't break it\n\t// TODO: make RANCHER_BOOT bootable - it might not be device 1\n\n\tbootflag := \"boot\"\n\tif diskType == \"gpt\" {\n\t\tbootflag = \"legacy_boot\"\n\t}\n\tlog.Debugf(\"making device 1 on %s bootable as %s\", device, diskType)\n\tcmd := exec.Command(\"parted\", \"-s\", \"-a\", \"optimal\", device, \"set 1 \"+bootflag+\" on\")\n\tcmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"parted: %s\", err)\n\t\treturn err\n\t}\n\treturn nil\n}\n\nfunc upgradeBootloader(device, baseName, diskType string) error {\n\tlog.Debugf(\"start upgradeBootloader\")\n\n\tgrubDir := filepath.Join(baseName, config.BootDir, \"grub\")\n\tif _, err := os.Stat(grubDir); os.IsNotExist(err) {\n\t\tlog.Debugf(\"%s does not exist - no need to upgrade bootloader\", grubDir)\n\t\t// we've already upgraded\n\t\t// TODO: in v0.9.0, need to detect what version syslinux we have\n\t\treturn nil\n\t}\n\t// deal with systems which were previously upgraded, then rolled back, and are now being re-upgraded\n\tgrubBackup := filepath.Join(baseName, config.BootDir, \"grub_backup\")\n\tif err := os.RemoveAll(grubBackup); err != nil {\n\t\tlog.Errorf(\"RemoveAll (%s): %s\", grubBackup, err)\n\t\treturn err\n\t}\n\tbackupSyslinuxDir := filepath.Join(baseName, config.BootDir, \"syslinux_backup\")\n\tif _, err := os.Stat(backupSyslinuxDir); !os.IsNotExist(err) {\n\t\tbackupSyslinuxLdlinuxSys := filepath.Join(backupSyslinuxDir, \"ldlinux.sys\")\n\t\tif _, err := os.Stat(backupSyslinuxLdlinuxSys); !os.IsNotExist(err) {\n\t\t\t//need a privileged container that can chattr -i ldlinux.sys\n\t\t\tcmd := exec.Command(\"chattr\", \"-i\", backupSyslinuxLdlinuxSys)\n\t\t\tif err := cmd.Run(); err != nil {\n\t\t\t\tlog.Errorf(\"%s\", err)\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\n\t\tif err := os.RemoveAll(backupSyslinuxDir); err != nil {\n\t\t\tlog.Errorf(\"RemoveAll (%s): %s\", backupSyslinuxDir, err)\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif err := os.Rename(grubDir, grubBackup); err != nil {\n\t\tlog.Errorf(\"Rename(%s): %s\", grubDir, err)\n\t\treturn err\n\t}\n\n\tsyslinuxDir := filepath.Join(baseName, config.BootDir, \"syslinux\")\n\t// it seems that v0.5.0 didn't have a syslinux dir, while 0.7 does\n\tif _, err := os.Stat(syslinuxDir); !os.IsNotExist(err) {\n\t\tif err := os.Rename(syslinuxDir, backupSyslinuxDir); err != nil {\n\t\t\tlog.Infof(\"error Rename(%s, %s): %s\", syslinuxDir, backupSyslinuxDir, err)\n\t\t} else {\n\t\t\t//mv the old syslinux into linux-previous.cfg\n\t\t\toldSyslinux, err := ioutil.ReadFile(filepath.Join(backupSyslinuxDir, \"syslinux.cfg\"))\n\t\t\tif err != nil {\n\t\t\t\tlog.Infof(\"error read(%s / syslinux.cfg): %s\", backupSyslinuxDir, err)\n\t\t\t} else {\n\t\t\t\tcfg := string(oldSyslinux)\n\t\t\t\t//DEFAULT BurmillaOS-current\n\t\t\t\t//\n\t\t\t\t//LABEL BurmillaOS-current\n\t\t\t\t// LINUX ../vmlinuz-v0.7.1-rancheros\n\t\t\t\t// APPEND rancher.state.dev=LABEL=RANCHER_STATE rancher.state.wait console=tty0 rancher.password=rancher\n\t\t\t\t// INITRD ../initrd-v0.7.1-rancheros\n\n\t\t\t\tcfg = strings.Replace(cfg, \"current\", \"previous\", -1)\n\t\t\t\t// TODO consider removing the APPEND line - as the global.cfg should have the same result\n\t\t\t\tioutil.WriteFile(filepath.Join(baseName, config.BootDir, \"linux-current.cfg\"), []byte(cfg), 0644)\n\n\t\t\t\tlines := strings.Split(cfg, \"\\n\")\n\t\t\t\tfor _, line := range lines {\n\t\t\t\t\tline = strings.TrimSpace(line)\n\t\t\t\t\tif strings.HasPrefix(line, \"APPEND\") {\n\t\t\t\t\t\tlog.Errorf(\"write new (%s) %s\", filepath.Join(baseName, config.BootDir, \"global.cfg\"), err)\n\t\t\t\t\t\t// TODO: need to append any extra's the user specified\n\t\t\t\t\t\tioutil.WriteFile(filepath.Join(baseName, config.BootDir, \"global.cfg\"), []byte(cfg), 0644)\n\t\t\t\t\t\tbreak\n\t\t\t\t\t}\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\t}\n\n\treturn installSyslinux(device, baseName, diskType)\n}\n\nfunc installSyslinux(device, baseName, diskType string) error {\n\tlog.Debugf(\"installSyslinux(%s)\", device)\n\n\tmbrFile := \"mbr.bin\"\n\tif diskType == \"gpt\" {\n\t\tmbrFile = \"gptmbr.bin\"\n\t}\n\n\t//dd bs=440 count=1 if=/usr/lib/syslinux/mbr/mbr.bin of=${device}\n\t// ubuntu: /usr/lib/syslinux/mbr/mbr.bin\n\t// alpine: /usr/share/syslinux/mbr.bin\n\tif device == \"/dev/\" {\n\t\tlog.Debugf(\"installSyslinuxRaid(%s)\", device)\n\t\t//RAID - assume sda&sdb\n\t\t//TODO: fix this - not sure how to detect what disks should have mbr - perhaps we need a param\n\t\t// perhaps just assume and use the devices that make up the raid - mdadm\n\t\tdevice = \"/dev/sda\"\n\t\tif err := setBootable(device, diskType); err != nil {\n\t\t\tlog.Errorf(\"setBootable(%s, %s): %s\", device, diskType, err)\n\t\t\t//return err\n\t\t}\n\t\tcmd := exec.Command(\"dd\", \"bs=440\", \"count=1\", \"if=/usr/share/syslinux/\"+mbrFile, \"of=\"+device)\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Errorf(\"%s\", err)\n\t\t\treturn err\n\t\t}\n\t\tdevice = \"/dev/sdb\"\n\t\tif err := setBootable(device, diskType); err != nil {\n\t\t\tlog.Errorf(\"setBootable(%s, %s): %s\", device, diskType, err)\n\t\t\t//return err\n\t\t}\n\t\tcmd = exec.Command(\"dd\", \"bs=440\", \"count=1\", \"if=/usr/share/syslinux/\"+mbrFile, \"of=\"+device)\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Errorf(\"%s\", err)\n\t\t\treturn err\n\t\t}\n\t} else {\n\t\tif err := setBootable(device, diskType); err != nil {\n\t\t\tlog.Errorf(\"setBootable(%s, %s): %s\", device, diskType, err)\n\t\t\t//return err\n\t\t}\n\t\tlog.Debugf(\"installSyslinux(%s)\", device)\n\t\tcmd := exec.Command(\"dd\", \"bs=440\", \"count=1\", \"if=/usr/share/syslinux/\"+mbrFile, \"of=\"+device)\n\t\tlog.Debugf(\"Run(%v)\", cmd)\n\t\tif err := cmd.Run(); err != nil {\n\t\t\tlog.Errorf(\"dd: %s\", err)\n\t\t\treturn err\n\t\t}\n\t}\n\n\tsysLinuxDir := filepath.Join(baseName, config.BootDir, \"syslinux\")\n\tif err := os.MkdirAll(sysLinuxDir, 0755); err != nil {\n\t\tlog.Errorf(\"MkdirAll(%s)): %s\", sysLinuxDir, err)\n\t\t//return err\n\t}\n\n\t//cp /usr/lib/syslinux/modules/bios/* ${baseName}/${bootDir}syslinux\n\tfiles, _ := ioutil.ReadDir(\"/usr/share/syslinux/\")\n\tfor _, file := range files {\n\t\tif file.IsDir() {\n\t\t\tcontinue\n\t\t}\n\t\tif err := dfs.CopyFile(filepath.Join(\"/usr/share/syslinux/\", file.Name()), sysLinuxDir, file.Name()); err != nil {\n\t\t\tlog.Errorf(\"copy syslinux: %s\", err)\n\t\t\treturn err\n\t\t}\n\t}\n\n\t//extlinux --install ${baseName}/${bootDir}syslinux\n\tcmd := exec.Command(\"extlinux\", \"--install\", sysLinuxDir)\n\tif device == \"/dev/\" {\n\t\t//extlinux --install --raid ${baseName}/${bootDir}syslinux\n\t\tcmd = exec.Command(\"extlinux\", \"--install\", \"--raid\", sysLinuxDir)\n\t}\n\t//cmd.Stdout, cmd.Stderr = os.Stdout, os.Stderr\n\tlog.Debugf(\"Run(%v)\", cmd)\n\tif err := cmd.Run(); err != nil {\n\t\tlog.Errorf(\"extlinux: %s\", err)\n\t\treturn err\n\t}\n\treturn nil\n}\n\nfunc different(existing, new string) bool {\n\t// assume existing file exists\n\tif _, err := os.Stat(new); os.IsNotExist(err) {\n\t\treturn true\n\t}\n\tdata, err := ioutil.ReadFile(existing)\n\tif err != nil {\n\t\treturn true\n\t}\n\tnewData, err := ioutil.ReadFile(new)\n\tif err != nil {\n\t\treturn true\n\t}\n\tmd5sum := md5.Sum(data)\n\tnewmd5sum := md5.Sum(newData)\n\tif md5sum != newmd5sum {\n\t\treturn true\n\t}\n\treturn false\n}\n\nfunc installRancher(baseName, VERSION, DIST, kappend string) (string, error) {\n\tlog.Debugf(\"installRancher\")\n\n\t// detect if there already is a linux-current.cfg, if so, move it to linux-previous.cfg,\n\tcurrentCfg := filepath.Join(baseName, config.BootDir, \"linux-current.cfg\")\n\tif _, err := os.Stat(currentCfg); !os.IsNotExist(err) {\n\t\texistingCfg := filepath.Join(DIST, \"linux-current.cfg\")\n\t\t// only remove previous if there is a change to the current\n\t\tif different(currentCfg, existingCfg) {\n\t\t\tpreviousCfg := filepath.Join(baseName, config.BootDir, \"linux-previous.cfg\")\n\t\t\tif _, err := os.Stat(previousCfg); !os.IsNotExist(err) {\n\t\t\t\tif err := os.Remove(previousCfg); err != nil {\n\t\t\t\t\treturn currentCfg, err\n\t\t\t\t}\n\t\t\t}\n\t\t\tos.Rename(currentCfg, previousCfg)\n\t\t\t// TODO: now that we're parsing syslinux.cfg files, maybe we can delete old kernels and initrds\n\t\t}\n\t}\n\n\t// The image/ISO have all the files in it - the syslinux cfg's and the kernel&initrd, so we can copy them all from there\n\tfiles, _ := ioutil.ReadDir(DIST)\n\tfor _, file := range files {\n\t\tif file.IsDir() {\n\t\t\tcontinue\n\t\t}\n\t\t// TODO: should overwrite anything other than the global.cfg\n\t\toverwrite := true\n\t\tif file.Name() == \"global.cfg\" {\n\t\t\toverwrite = false\n\t\t}\n\t\tif err := dfs.CopyFileOverwrite(filepath.Join(DIST, file.Name()), filepath.Join(baseName, config.BootDir), file.Name(), overwrite); err != nil {\n\t\t\tlog.Errorf(\"copy %s: %s\", file.Name(), err)\n\t\t\t//return err\n\t\t}\n\t}\n\n\t// the general INCLUDE syslinuxcfg\n\tisolinuxFile := filepath.Join(DIST, \"isolinux\", \"isolinux.cfg\")\n\tsyslinuxDir := filepath.Join(baseName, config.BootDir, \"syslinux\")\n\tif err := dfs.CopyFileOverwrite(isolinuxFile, syslinuxDir, \"syslinux.cfg\", true); err != nil {\n\t\tlog.Errorf(\"copy global syslinux.cfgS%s: %s\", \"syslinux.cfg\", err)\n\t\t//return err\n\t} else {\n\t\tlog.Debugf(\"installRancher copy global syslinux.cfgS OK\")\n\n\t}\n\n\t// The global.cfg INCLUDE - useful for over-riding the APPEND line\n\tglobalFile := filepath.Join(baseName, config.BootDir, \"global.cfg\")\n\tif _, err := os.Stat(globalFile); !os.IsNotExist(err) {\n\t\terr := ioutil.WriteFile(globalFile, []byte(\"APPEND \"+kappend), 0644)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"write (%s) %s\", \"global.cfg\", err)\n\t\t\treturn currentCfg, err\n\t\t}\n\t}\n\treturn currentCfg, nil\n}\n" }, { "path": "cmd/control/os.go", "content": "package control\n\nimport (\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"net/url\"\n\t\"os\"\n\t\"runtime\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/cmd/power\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\t\"github.com/burmilla/os/pkg/util/network\"\n\n\tyaml \"github.com/cloudfoundry-incubator/candiedyaml\"\n\t\"github.com/codegangsta/cli\"\n\tdockerClient \"github.com/docker/engine-api/client\"\n\tcomposeConfig \"github.com/docker/libcompose/config\"\n\t\"github.com/docker/libcompose/project/options\"\n\t\"golang.org/x/net/context\"\n)\n\ntype Images struct {\n\tCurrent string `yaml:\"current,omitempty\"`\n\tAvailable []string `yaml:\"available,omitempty\"`\n}\n\nfunc osSubcommands() []cli.Command {\n\treturn []cli.Command{\n\t\t{\n\t\t\tName: \"upgrade\",\n\t\t\tUsage: \"upgrade to latest version\",\n\t\t\tAction: osUpgrade,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"stage, s\",\n\t\t\t\t\tUsage: \"Only stage the new upgrade, don't apply it\",\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"image, i\",\n\t\t\t\t\tUsage: \"upgrade to a certain image\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"force, f\",\n\t\t\t\t\tUsage: \"do not prompt for input\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"no-reboot\",\n\t\t\t\t\tUsage: \"do not reboot after upgrade\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"kexec, k\",\n\t\t\t\t\tUsage: \"reboot using kexec\",\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"append\",\n\t\t\t\t\tUsage: \"append additional kernel parameters\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"upgrade-console\",\n\t\t\t\t\tUsage: \"upgrade console even if persistent\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"debug\",\n\t\t\t\t\tUsage: \"Run installer with debug output\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t\t{\n\t\t\tName: \"list\",\n\t\t\tUsage: \"list the current available versions\",\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"update, u\",\n\t\t\t\t\tUsage: \"update engine cache\",\n\t\t\t\t},\n\t\t\t},\n\t\t\tAction: osMetaDataGet,\n\t\t},\n\t\t{\n\t\t\tName: \"version\",\n\t\t\tUsage: \"show the currently installed version\",\n\t\t\tAction: osVersion,\n\t\t},\n\t}\n}\n\nfunc getImages(update bool) (*Images, error) {\n\tupgradeURL, err := getUpgradeURL()\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\tvar body []byte\n\n\tif strings.HasPrefix(upgradeURL, \"/\") {\n\t\tbody, err = ioutil.ReadFile(upgradeURL)\n\t\tif err != nil {\n\t\t\treturn nil, err\n\t\t}\n\t} else {\n\t\tu, err := url.Parse(upgradeURL)\n\t\tif err != nil {\n\t\t\treturn nil, err\n\t\t}\n\n\t\tq := u.Query()\n\t\tq.Set(\"current\", config.Version)\n\t\tif hypervisor := util.GetHypervisor(); hypervisor == \"\" {\n\t\t\tq.Set(\"hypervisor\", hypervisor)\n\t\t}\n\t\tu.RawQuery = q.Encode()\n\t\tupgradeURL = u.String()\n\n\t\tif update {\n\t\t\t_, err := network.UpdateCache(upgradeURL)\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"Failed to update os caches: %v\", err)\n\t\t\t}\n\t\t}\n\n\t\tbody, err = network.LoadFromNetwork(upgradeURL)\n\t\tif err != nil {\n\t\t\treturn nil, err\n\t\t}\n\t}\n\n\timages, err := parseBody(body)\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\tcfg := config.LoadConfig()\n\timages.Current = formatImage(images.Current, cfg)\n\tfor i := len(images.Available) - 1; i >= 0; i-- {\n\t\timages.Available[i] = formatImage(images.Available[i], cfg)\n\t}\n\n\treturn images, nil\n}\n\nfunc osMetaDataGet(c *cli.Context) error {\n\timages, err := getImages(c.Bool(\"update\"))\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tcfg := config.LoadConfig()\n\trunningName := cfg.Rancher.Upgrade.Image + \":\" + config.Version\n\trunningName = formatImage(runningName, cfg)\n\n\tfoundRunning := false\n\tfor i := len(images.Available) - 1; i >= 0; i-- {\n\t\timage := images.Available[i]\n\t\t_, _, err := client.ImageInspectWithRaw(context.Background(), image, false)\n\t\tlocal := \"local\"\n\t\tif dockerClient.IsErrImageNotFound(err) {\n\t\t\tlocal = \"remote\"\n\t\t}\n\t\tavailable := \"available\"\n\t\tif image == images.Current {\n\t\t\tavailable = \"latest\"\n\t\t}\n\t\tvar running string\n\t\tif image == runningName {\n\t\t\tfoundRunning = true\n\t\t\trunning = \"running\"\n\t\t}\n\t\tfmt.Println(image, local, available, running)\n\t}\n\tif !foundRunning {\n\t\tfmt.Println(config.Version, \"running\")\n\t}\n\n\treturn nil\n}\n\nfunc getLatestImage() (string, error) {\n\timages, err := getImages(false)\n\tif err != nil {\n\t\treturn \"\", err\n\t}\n\n\treturn images.Current, nil\n}\n\nfunc osUpgrade(c *cli.Context) error {\n\tif runtime.GOARCH != \"amd64\" {\n\t\tlog.Fatalf(\"ros install / upgrade only supported on 'amd64', not '%s'\", runtime.GOARCH)\n\t}\n\n\tif isExist := checkGlobalCfg(); !isExist {\n\t\tlog.Fatalf(\"ros upgrade cannot be supported\")\n\t}\n\n\timage := c.String(\"image\")\n\n\tif image == \"\" {\n\t\tvar err error\n\t\timage, err = getLatestImage()\n\t\tif err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t\tif image == \"\" {\n\t\t\tlog.Fatal(\"Failed to find latest image\")\n\t\t}\n\t}\n\tif c.Args().Present() {\n\t\tlog.Fatalf(\"invalid arguments %v\", c.Args())\n\t}\n\tif err := startUpgradeContainer(\n\t\timage,\n\t\tc.Bool(\"stage\"),\n\t\tc.Bool(\"force\"),\n\t\t!c.Bool(\"no-reboot\"),\n\t\tc.Bool(\"kexec\"),\n\t\tc.Bool(\"upgrade-console\"),\n\t\tc.Bool(\"debug\"),\n\t\tc.String(\"append\"),\n\t); err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\treturn nil\n}\n\nfunc osVersion(c *cli.Context) error {\n\tfmt.Println(config.Version)\n\treturn nil\n}\n\nfunc startUpgradeContainer(image string, stage, force, reboot, kexec, upgradeConsole, debug bool, kernelArgs string) error {\n\tcommand := []string{\n\t\t\"-t\", \"rancher-upgrade\",\n\t\t\"-r\", config.Version,\n\t}\n\n\tif kexec {\n\t\tcommand = append(command, \"--kexec\")\n\t}\n\tif debug {\n\t\tcommand = append(command, \"--debug\")\n\t}\n\n\tkernelArgs = strings.TrimSpace(kernelArgs)\n\tif kernelArgs != \"\" {\n\t\tcommand = append(command, \"-a\", kernelArgs)\n\t}\n\n\tif upgradeConsole {\n\t\tif err := config.Set(\"rancher.force_console_rebuild\", true); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\tfmt.Printf(\"Upgrading to %s\\n\", image)\n\tconfirmation := \"Continue\"\n\timageSplit := strings.Split(image, \":\")\n\tif len(imageSplit) > 1 && imageSplit[1] == config.Version+config.Suffix {\n\t\tconfirmation = fmt.Sprintf(\"Already at version %s. Continue anyway\", imageSplit[1])\n\t}\n\tif !force && !yes(confirmation) {\n\t\tos.Exit(1)\n\t}\n\n\tcontainer, err := compose.CreateService(nil, \"os-upgrade\", &composeConfig.ServiceConfigV1{\n\t\tLogDriver: \"json-file\",\n\t\tPrivileged: true,\n\t\tNet: \"host\",\n\t\tPid: \"host\",\n\t\tImage: image,\n\t\tLabels: map[string]string{\n\t\t\tconfig.ScopeLabel: config.System,\n\t\t},\n\t\tCommand: command,\n\t})\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Only pull image if not found locally\n\tif _, _, err := client.ImageInspectWithRaw(context.Background(), image, false); err != nil {\n\t\tif err := container.Pull(context.Background()); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif !stage {\n\t\t// If there is already an upgrade container, delete it\n\t\t// Up() should to this, but currently does not due to a bug\n\t\tif err := container.Delete(context.Background(), options.Delete{}); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif err := container.Up(context.Background(), options.Up{}); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif err := container.Log(context.Background(), true); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif err := container.Delete(context.Background(), options.Delete{}); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif reboot && (force || yes(\"Continue with reboot\")) {\n\t\t\tlog.Info(\"Rebooting\")\n\t\t\tpower.Reboot()\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc parseBody(body []byte) (*Images, error) {\n\tupdate := &Images{}\n\terr := yaml.Unmarshal(body, update)\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\treturn update, nil\n}\n\nfunc getUpgradeURL() (string, error) {\n\tcfg := config.LoadConfig()\n\treturn cfg.Rancher.Upgrade.URL, nil\n}\n" }, { "path": "cmd/control/preload.go", "content": "package control\n\nimport (\n\t\"compress/gzip\"\n\t\"context\"\n\t\"fmt\"\n\t\"io\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"path\"\n\t\"regexp\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n\tdockerClient \"github.com/docker/engine-api/client\"\n\t\"github.com/docker/engine-api/types\"\n)\n\nconst (\n\tuserImagesPreloadDirectory = \"/var/lib/rancher/preload/docker\"\n)\n\nfunc preloadImagesAction(c *cli.Context) error {\n\terr := PreloadImages(docker.NewDefaultClient, userImagesPreloadDirectory)\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to preload user images: %v\", err)\n\t}\n\treturn err\n}\n\nfunc shouldLoad(file string) bool {\n\tif strings.HasSuffix(file, \".done\") {\n\t\treturn false\n\t}\n\tif _, err := os.Stat(fmt.Sprintf(\"%s.done\", file)); err == nil {\n\t\treturn false\n\t}\n\treturn true\n}\n\nfunc PreloadImages(clientFactory func() (dockerClient.APIClient, error), imagesDir string) error {\n\tvar client dockerClient.APIClient\n\tclientInitialized := false\n\n\tif _, err := os.Stat(imagesDir); os.IsNotExist(err) {\n\t\tif err = os.MkdirAll(imagesDir, 0755); err != nil {\n\t\t\treturn err\n\t\t}\n\t} else if err != nil {\n\t\treturn err\n\t}\n\n\t// try to load predefined user images\n\tif imagesDir == userImagesPreloadDirectory {\n\t\toldUserImgName := path.Join(config.ImagesPath, config.UserImages)\n\t\tuserImgfile, err := os.Stat(oldUserImgName)\n\t\tif err == nil {\n\t\t\tnewUserImgName := path.Join(userImagesPreloadDirectory, userImgfile.Name())\n\t\t\tif _, err = os.Stat(newUserImgName); os.IsNotExist(err) {\n\t\t\t\tif err := os.Symlink(oldUserImgName, newUserImgName); err != nil {\n\t\t\t\t\tlog.Error(err)\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\t}\n\n\tfiles, err := ioutil.ReadDir(imagesDir)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor _, file := range files {\n\t\tfilename := path.Join(imagesDir, file.Name())\n\t\tif !shouldLoad(filename) {\n\t\t\tlog.Infof(\"Skipping to preload the file: %s\", filename)\n\t\t\tcontinue\n\t\t}\n\n\t\timage, err := os.Open(filename)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tdefer image.Close()\n\t\tvar imageReader io.Reader\n\t\timageReader = image\n\t\tmatch, err := regexp.MatchString(\".t?gz$\", file.Name())\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif match {\n\t\t\timageReader, err = gzip.NewReader(image)\n\t\t\tif err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\n\t\tif !clientInitialized {\n\t\t\tclient, err = clientFactory()\n\t\t\tif err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t\tclientInitialized = true\n\t\t}\n\n\t\tvar imageLoadResponse types.ImageLoadResponse\n\t\tif imageLoadResponse, err = client.ImageLoad(context.Background(), imageReader, false); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tcfg := config.LoadConfig()\n\t\tif cfg.Rancher.PreloadWait {\n\t\t\tif _, err := ioutil.ReadAll(imageLoadResponse.Body); err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\n\t\tlog.Infof(\"Finished to load image %s\", filename)\n\n\t\tlog.Infof(\"Creating done stamp file for image %s\", filename)\n\t\tdoneStamp, err := os.Create(fmt.Sprintf(\"%s.done\", filename))\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tdefer doneStamp.Close()\n\t\tlog.Infof(\"Finished to created the done stamp file for image %s\", filename)\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/control/recovery_init.go", "content": "package control\n\nimport (\n\t\"os\"\n\t\"os/exec\"\n\t\"syscall\"\n\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nfunc recoveryInitAction(c *cli.Context) error {\n\tif err := writeRespawn(\"root\", false, true); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\trespawnBinPath, err := exec.LookPath(\"respawn\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn syscall.Exec(respawnBinPath, []string{\"respawn\", \"-f\", \"/etc/respawn.conf\"}, os.Environ())\n}\n" }, { "path": "cmd/control/service/app/app.go", "content": "package app\n\nimport (\n\t\"fmt\"\n\t\"os\"\n\t\"os/signal\"\n\t\"strings\"\n\t\"syscall\"\n\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n\t\"github.com/docker/libcompose/project\"\n\t\"github.com/docker/libcompose/project/options\"\n\t\"golang.org/x/net/context\"\n)\n\nfunc ProjectPs(p project.APIProject, c *cli.Context) error {\n\tqFlag := c.Bool(\"q\")\n\tallInfo, err := p.Ps(context.Background(), qFlag, c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\tos.Stdout.WriteString(allInfo.String(!qFlag))\n\treturn nil\n}\n\nfunc ProjectStop(p project.APIProject, c *cli.Context) error {\n\terr := p.Stop(context.Background(), c.Int(\"timeout\"), c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectDown(p project.APIProject, c *cli.Context) error {\n\toptions := options.Down{\n\t\tRemoveVolume: c.Bool(\"volumes\"),\n\t\tRemoveImages: options.ImageType(c.String(\"rmi\")),\n\t\tRemoveOrphans: c.Bool(\"remove-orphans\"),\n\t}\n\terr := p.Down(context.Background(), options, c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectBuild(p project.APIProject, c *cli.Context) error {\n\tconfig := options.Build{\n\t\tNoCache: c.Bool(\"no-cache\"),\n\t\tForceRemove: c.Bool(\"force-rm\"),\n\t\tPull: c.Bool(\"pull\"),\n\t}\n\terr := p.Build(context.Background(), config, c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectCreate(p project.APIProject, c *cli.Context) error {\n\toptions := options.Create{\n\t\tNoRecreate: c.Bool(\"no-recreate\"),\n\t\tForceRecreate: c.Bool(\"force-recreate\"),\n\t\tNoBuild: c.Bool(\"no-build\"),\n\t}\n\terr := p.Create(context.Background(), options, c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectUp(p project.APIProject, c *cli.Context) error {\n\toptions := options.Up{\n\t\tCreate: options.Create{\n\t\t\tNoRecreate: c.Bool(\"no-recreate\"),\n\t\t\tForceRecreate: c.Bool(\"force-recreate\"),\n\t\t\tNoBuild: c.Bool(\"no-build\"),\n\t\t},\n\t}\n\tctx, cancelFun := context.WithCancel(context.Background())\n\terr := p.Up(ctx, options, c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\n\tif c.Bool(\"foreground\") {\n\t\tsignalChan := make(chan os.Signal, 1)\n\t\tcleanupDone := make(chan bool)\n\t\tsignal.Notify(signalChan, syscall.SIGINT, syscall.SIGTERM)\n\t\terrChan := make(chan error)\n\t\tgo func() {\n\t\t\terrChan <- p.Log(ctx, true, c.Args()...)\n\t\t}()\n\t\tgo func() {\n\t\t\tselect {\n\t\t\tcase <-signalChan:\n\t\t\t\tfmt.Printf(\"\\nGracefully stopping...\\n\")\n\t\t\t\tcancelFun()\n\t\t\t\tProjectStop(p, c)\n\t\t\t\tcleanupDone <- true\n\t\t\tcase err := <-errChan:\n\t\t\t\tif err != nil {\n\t\t\t\t\tlog.Fatal(err)\n\t\t\t\t}\n\t\t\t\tcleanupDone <- true\n\t\t\t}\n\t\t}()\n\t\t<-cleanupDone\n\t\treturn nil\n\t}\n\treturn nil\n}\n\nfunc ProjectStart(p project.APIProject, c *cli.Context) error {\n\terr := p.Start(context.Background(), c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectRestart(p project.APIProject, c *cli.Context) error {\n\terr := p.Restart(context.Background(), c.Int(\"timeout\"), c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectLog(p project.APIProject, c *cli.Context) error {\n\terr := p.Log(context.Background(), c.Bool(\"follow\"), c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectPull(p project.APIProject, c *cli.Context) error {\n\terr := p.Pull(context.Background(), c.Args()...)\n\tif err != nil && !c.Bool(\"ignore-pull-failures\") {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectDelete(p project.APIProject, c *cli.Context) error {\n\toptions := options.Delete{\n\t\tRemoveVolume: c.Bool(\"v\"),\n\t}\n\tif !c.Bool(\"force\") {\n\t\toptions.BeforeDeleteCallback = func(stoppedContainers []string) bool {\n\t\t\tfmt.Printf(\"Going to remove %v\\nAre you sure? [yN]\\n\", strings.Join(stoppedContainers, \", \"))\n\t\t\tvar answer string\n\t\t\t_, err := fmt.Scanln(&answer)\n\t\t\tif err != nil {\n\t\t\t\tlog.Error(err)\n\t\t\t\treturn false\n\t\t\t}\n\t\t\tif answer != \"y\" && answer != \"Y\" {\n\t\t\t\treturn false\n\t\t\t}\n\t\t\treturn true\n\t\t}\n\t}\n\terr := p.Delete(context.Background(), options, c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n\nfunc ProjectKill(p project.APIProject, c *cli.Context) error {\n\terr := p.Kill(context.Background(), c.String(\"signal\"), c.Args()...)\n\tif err != nil {\n\t\treturn cli.NewExitError(err.Error(), 1)\n\t}\n\treturn nil\n}\n" }, { "path": "cmd/control/service/command/command.go", "content": "package command\n\nimport (\n\t\"errors\"\n\n\t\"github.com/burmilla/os/cmd/control/service/app\"\n\n\t\"github.com/codegangsta/cli\"\n\tcomposeApp \"github.com/docker/libcompose/cli/app\"\n)\n\nfunc verifyOneOrMoreServices(c *cli.Context) error {\n\tif len(c.Args()) == 0 {\n\t\treturn errors.New(\"Must specify one or more services\")\n\t}\n\treturn nil\n}\n\nfunc CreateCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"create\",\n\t\tUsage: \"Create services\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectCreate),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"no-recreate\",\n\t\t\t\tUsage: \"If containers already exist, don't recreate them. Incompatible with --force-recreate.\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"force-recreate\",\n\t\t\t\tUsage: \"Recreate containers even if their configuration and image haven't changed. Incompatible with --no-recreate.\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"no-build\",\n\t\t\t\tUsage: \"Don't build an image, even if it's missing.\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc BuildCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"build\",\n\t\tUsage: \"Build or rebuild services\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectBuild),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"no-cache\",\n\t\t\t\tUsage: \"Do not use cache when building the image\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"force-rm\",\n\t\t\t\tUsage: \"Always remove intermediate containers\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"pull\",\n\t\t\t\tUsage: \"Always attempt to pull a newer version of the image\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc PsCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"ps\",\n\t\tUsage: \"List containers\",\n\t\tAction: composeApp.WithProject(factory, app.ProjectPs),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"q\",\n\t\t\t\tUsage: \"Only display IDs\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc UpCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"up\",\n\t\tUsage: \"Create and start containers\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectUp),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"foreground\",\n\t\t\t\tUsage: \"Run in foreground and log\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"no-build\",\n\t\t\t\tUsage: \"Don't build an image, even if it's missing.\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"no-recreate\",\n\t\t\t\tUsage: \"If containers already exist, don't recreate them. Incompatible with --force-recreate.\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"force-recreate\",\n\t\t\t\tUsage: \"Recreate containers even if their configuration and image haven't changed. Incompatible with --no-recreate.\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc StartCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"start\",\n\t\tUsage: \"Start services\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectStart),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolTFlag{\n\t\t\t\tName: \"foreground\",\n\t\t\t\tUsage: \"Run in foreground and log\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc PullCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"pull\",\n\t\tUsage: \"Pulls service images\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectPull),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"ignore-pull-failures\",\n\t\t\t\tUsage: \"Pull what it can and ignores images with pull failures.\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc LogsCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"logs\",\n\t\tUsage: \"View output from containers\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectLog),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.IntFlag{\n\t\t\t\tName: \"lines\",\n\t\t\t\tUsage: \"number of lines to tail\",\n\t\t\t\tValue: 100,\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"follow, f\",\n\t\t\t\tUsage: \"Follow log output.\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc RestartCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"restart\",\n\t\tUsage: \"Restart services\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectRestart),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.IntFlag{\n\t\t\t\tName: \"timeout,t\",\n\t\t\t\tUsage: \"Specify a shutdown timeout in seconds.\",\n\t\t\t\tValue: 10,\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc StopCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"stop\",\n\t\tUsage: \"Stop services\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectStop),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.IntFlag{\n\t\t\t\tName: \"timeout,t\",\n\t\t\t\tUsage: \"Specify a shutdown timeout in seconds.\",\n\t\t\t\tValue: 10,\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc DownCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"down\",\n\t\tUsage: \"Stop and remove containers, networks, images, and volumes\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectDown),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"volumes,v\",\n\t\t\t\tUsage: \"Remove data volumes\",\n\t\t\t},\n\t\t\tcli.StringFlag{\n\t\t\t\tName: \"rmi\",\n\t\t\t\tUsage: \"Remove images, type may be one of: 'all' to remove all images, or 'local' to remove only images that don't have an custom name set by the `image` field\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"remove-orphans\",\n\t\t\t\tUsage: \"Remove containers for services not defined in the Compose file\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc RmCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"rm\",\n\t\tUsage: \"Delete services\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectDelete),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"force,f\",\n\t\t\t\tUsage: \"Allow deletion of all services\",\n\t\t\t},\n\t\t\tcli.BoolFlag{\n\t\t\t\tName: \"v\",\n\t\t\t\tUsage: \"Remove volumes associated with containers\",\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc KillCommand(factory composeApp.ProjectFactory) cli.Command {\n\treturn cli.Command{\n\t\tName: \"kill\",\n\t\tUsage: \"Kill containers\",\n\t\tBefore: verifyOneOrMoreServices,\n\t\tAction: composeApp.WithProject(factory, app.ProjectKill),\n\t\tFlags: []cli.Flag{\n\t\t\tcli.StringFlag{\n\t\t\t\tName: \"signal,s\",\n\t\t\t\tUsage: \"SIGNAL to send to the container\",\n\t\t\t\tValue: \"SIGKILL\",\n\t\t\t},\n\t\t},\n\t}\n}\n" }, { "path": "cmd/control/service/service.go", "content": "package service\n\nimport (\n\t\"fmt\"\n\t\"strings\"\n\n\t\"github.com/burmilla/os/cmd/control/service/command\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\t\"github.com/burmilla/os/pkg/util/network\"\n\n\t\"github.com/codegangsta/cli\"\n\tdockerApp \"github.com/docker/libcompose/cli/docker/app\"\n\t\"github.com/docker/libcompose/project\"\n)\n\ntype projectFactory struct {\n}\n\nfunc (p *projectFactory) Create(c *cli.Context) (project.APIProject, error) {\n\tcfg := config.LoadConfig()\n\treturn compose.GetProject(cfg, true, false)\n}\n\nfunc beforeApp(c *cli.Context) error {\n\tif c.GlobalBool(\"verbose\") {\n\t\tlog.SetLevel(log.DebugLevel)\n\t}\n\treturn nil\n}\n\nfunc Commands() cli.Command {\n\tfactory := &projectFactory{}\n\n\tapp := cli.Command{}\n\tapp.Name = \"service\"\n\tapp.ShortName = \"s\"\n\tapp.Before = beforeApp\n\tapp.Flags = append(dockerApp.DockerClientFlags(), cli.BoolFlag{\n\t\tName: \"verbose,debug\",\n\t})\n\tapp.Subcommands = append(serviceSubCommands(),\n\t\tcommand.BuildCommand(factory),\n\t\tcommand.CreateCommand(factory),\n\t\tcommand.UpCommand(factory),\n\t\tcommand.StartCommand(factory),\n\t\tcommand.LogsCommand(factory),\n\t\tcommand.RestartCommand(factory),\n\t\tcommand.StopCommand(factory),\n\t\tcommand.RmCommand(factory),\n\t\tcommand.PullCommand(factory),\n\t\tcommand.KillCommand(factory),\n\t\tcommand.PsCommand(factory),\n\t)\n\n\treturn app\n}\n\nfunc serviceSubCommands() []cli.Command {\n\treturn []cli.Command{\n\t\t{\n\t\t\tName: \"enable\",\n\t\t\tUsage: \"turn on an service\",\n\t\t\tAction: enable,\n\t\t},\n\t\t{\n\t\t\tName: \"disable\",\n\t\t\tUsage: \"turn off an service\",\n\t\t\tAction: disable,\n\t\t},\n\t\t{\n\t\t\tName: \"list\",\n\t\t\tUsage: \"list services and state\",\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"all, a\",\n\t\t\t\t\tUsage: \"list all services and state\",\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"update, u\",\n\t\t\t\t\tUsage: \"update service cache\",\n\t\t\t\t},\n\t\t\t},\n\t\t\tAction: list,\n\t\t},\n\t\t{\n\t\t\tName: \"delete\",\n\t\t\tUsage: \"delete a service\",\n\t\t\tAction: del,\n\t\t},\n\t}\n}\n\nfunc updateIncludedServices(cfg *config.CloudConfig) error {\n\treturn config.Set(\"rancher.services_include\", cfg.Rancher.ServicesInclude)\n}\n\nfunc disable(c *cli.Context) error {\n\tchanged := false\n\tcfg := config.LoadConfig()\n\n\tfor _, service := range c.Args() {\n\t\tvalidateService(service, cfg)\n\n\t\tif _, ok := cfg.Rancher.ServicesInclude[service]; !ok {\n\t\t\tcontinue\n\t\t}\n\n\t\tcfg.Rancher.ServicesInclude[service] = false\n\t\tchanged = true\n\t}\n\n\tif changed {\n\t\tif err := updateIncludedServices(cfg); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc del(c *cli.Context) error {\n\tchanged := false\n\tcfg := config.LoadConfig()\n\n\tfor _, service := range c.Args() {\n\t\tvalidateService(service, cfg)\n\n\t\tif _, ok := cfg.Rancher.ServicesInclude[service]; !ok {\n\t\t\tcontinue\n\t\t}\n\n\t\tdelete(cfg.Rancher.ServicesInclude, service)\n\t\tchanged = true\n\t}\n\n\tif changed {\n\t\tif err := updateIncludedServices(cfg); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc enable(c *cli.Context) error {\n\tcfg := config.LoadConfig()\n\n\tvar enabledServices []string\n\n\tfor _, service := range c.Args() {\n\t\tvalidateService(service, cfg)\n\n\t\tif val, ok := cfg.Rancher.ServicesInclude[service]; !ok || !val {\n\t\t\tif isLocal(service) && !strings.HasPrefix(service, \"/var/lib/rancher/conf\") {\n\t\t\t\tlog.Fatalf(\"ERROR: Service should be in path /var/lib/rancher/conf\")\n\t\t\t}\n\n\t\t\tcfg.Rancher.ServicesInclude[service] = true\n\t\t\tenabledServices = append(enabledServices, service)\n\t\t}\n\t}\n\n\tif len(enabledServices) > 0 {\n\t\tif err := compose.StageServices(cfg, enabledServices...); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\n\t\tif err := updateIncludedServices(cfg); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc list(c *cli.Context) error {\n\tcfg := config.LoadConfig()\n\n\tclone := make(map[string]bool)\n\tfor service, enabled := range cfg.Rancher.ServicesInclude {\n\t\tclone[service] = enabled\n\t}\n\n\tservices := availableService(cfg, c.Bool(\"update\"))\n\n\tif c.Bool(\"all\") {\n\t\tfor service := range cfg.Rancher.Services {\n\t\t\tfmt.Printf(\"enabled %s\\n\", service)\n\t\t}\n\t}\n\n\tfor _, service := range services {\n\t\tif enabled, ok := clone[service]; ok {\n\t\t\tdelete(clone, service)\n\t\t\tif enabled {\n\t\t\t\tfmt.Printf(\"enabled %s\\n\", service)\n\t\t\t} else {\n\t\t\t\tfmt.Printf(\"disabled %s\\n\", service)\n\t\t\t}\n\t\t} else {\n\t\t\tfmt.Printf(\"disabled %s\\n\", service)\n\t\t}\n\t}\n\n\tfor service, enabled := range clone {\n\t\tif enabled {\n\t\t\tfmt.Printf(\"enabled %s\\n\", service)\n\t\t} else {\n\t\t\tfmt.Printf(\"disabled %s\\n\", service)\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc isLocal(service string) bool {\n\treturn strings.HasPrefix(service, \"/\")\n}\n\nfunc IsLocalOrURL(service string) bool {\n\treturn isLocal(service) || strings.HasPrefix(service, \"http:/\") || strings.HasPrefix(service, \"https:/\")\n}\n\n// ValidService checks to see if the service definition exists\nfunc ValidService(service string, cfg *config.CloudConfig) bool {\n\tservices := availableService(cfg, false)\n\tif !IsLocalOrURL(service) && !util.Contains(services, service) {\n\t\treturn false\n\t}\n\treturn true\n}\n\nfunc validateService(service string, cfg *config.CloudConfig) {\n\tif !ValidService(service, cfg) {\n\t\tlog.Fatalf(\"%s is not a valid service\", service)\n\t}\n}\n\nfunc availableService(cfg *config.CloudConfig, update bool) []string {\n\tif update {\n\t\terr := network.UpdateCaches(cfg.Rancher.Repositories.ToArray(), \"services\")\n\t\tif err != nil {\n\t\t\tlog.Debugf(\"Failed to update service caches: %v\", err)\n\t\t}\n\n\t}\n\tservices, err := network.GetServices(cfg.Rancher.Repositories.ToArray())\n\tif err != nil {\n\t\tlog.Fatalf(\"Failed to get services: %v\", err)\n\t}\n\treturn services\n}\n" }, { "path": "cmd/control/switch_console.go", "content": "package control\n\nimport (\n\t\"errors\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n\t\"github.com/docker/libcompose/project/options\"\n\t\"golang.org/x/net/context\"\n)\n\nfunc switchConsoleAction(c *cli.Context) error {\n\tif len(c.Args()) != 1 {\n\t\treturn errors.New(\"Must specify exactly one existing container\")\n\t}\n\tnewConsole := c.Args()[0]\n\n\tcfg := config.LoadConfig()\n\n\tproject, err := compose.GetProject(cfg, true, false)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// stop docker and console to avoid zombie process\n\tif err = project.Stop(context.Background(), 10, \"docker\"); err != nil {\n\t\tlog.Errorf(\"Failed to stop Docker: %v\", err)\n\t}\n\tif err = project.Stop(context.Background(), 10, \"console\"); err != nil {\n\t\tlog.Errorf(\"Failed to stop console: %v\", err)\n\t}\n\n\tif newConsole != \"default\" {\n\t\tif err = compose.LoadSpecialService(project, cfg, \"console\", newConsole); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif err = config.Set(\"rancher.console\", newConsole); err != nil {\n\t\tlog.Errorf(\"Failed to update 'rancher.console': %v\", err)\n\t}\n\n\tif err = project.Up(context.Background(), options.Up{\n\t\tLog: true,\n\t}, \"console\"); err != nil {\n\t\treturn err\n\t}\n\n\tif err = project.Start(context.Background(), \"docker\"); err != nil {\n\t\tlog.Errorf(\"Failed to start Docker: %v\", err)\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/control/tlsconf.go", "content": "package control\n\nimport (\n\t\"io/ioutil\"\n\t\"os\"\n\t\"path/filepath\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n\tmachineUtil \"github.com/docker/machine/utils\"\n)\n\nconst (\n\tNAME string = \"rancher\"\n\tBITS int = 2048\n\tServerTLSPath string = \"/etc/docker/tls\"\n\tClientTLSPath string = \"/home/rancher/.docker\"\n\tCert string = \"cert.pem\"\n\tKey string = \"key.pem\"\n\tServerCert string = \"server-cert.pem\"\n\tServerKey string = \"server-key.pem\"\n\tCaCert string = \"ca.pem\"\n\tCaKey string = \"ca-key.pem\"\n)\n\nfunc tlsConfCommands() []cli.Command {\n\treturn []cli.Command{\n\t\t{\n\t\t\tName: \"generate\",\n\t\t\tShortName: \"gen\",\n\t\t\tUsage: \"generates new set of TLS configuration certs\",\n\t\t\tAction: tlsConfCreate,\n\t\t\tFlags: []cli.Flag{\n\t\t\t\tcli.StringSliceFlag{\n\t\t\t\t\tName: \"hostname, H\",\n\t\t\t\t\tUsage: \"the hostname for which you want to generate the certificate\",\n\t\t\t\t\tValue: &cli.StringSlice{\"localhost\"},\n\t\t\t\t},\n\t\t\t\tcli.BoolFlag{\n\t\t\t\t\tName: \"server, s\",\n\t\t\t\t\tUsage: \"generate the server keys instead of client keys\",\n\t\t\t\t},\n\t\t\t\tcli.StringFlag{\n\t\t\t\t\tName: \"dir, d\",\n\t\t\t\t\tUsage: \"the directory to save/read the certs to/from\",\n\t\t\t\t\tValue: \"\",\n\t\t\t\t},\n\t\t\t},\n\t\t},\n\t}\n}\n\nfunc writeCerts(generateServer bool, hostname []string, certPath, keyPath, caCertPath, caKeyPath string) error {\n\tif !generateServer {\n\t\treturn machineUtil.GenerateCert([]string{\"\"}, certPath, keyPath, caCertPath, caKeyPath, NAME, BITS)\n\t}\n\n\tif err := machineUtil.GenerateCert(hostname, certPath, keyPath, caCertPath, caKeyPath, NAME, BITS); err != nil {\n\t\treturn err\n\t}\n\n\tcert, err := ioutil.ReadFile(certPath)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tkey, err := ioutil.ReadFile(keyPath)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// certPath, keyPath are already written to by machineUtil.GenerateCert()\n\tif err := config.Set(\"rancher.docker.server_cert\", string(cert)); err != nil {\n\t\treturn err\n\t}\n\treturn config.Set(\"rancher.docker.server_key\", string(key))\n}\n\nfunc writeCaCerts(cfg *config.CloudConfig, caCertPath, caKeyPath string) error {\n\tif cfg.Rancher.Docker.CACert == \"\" {\n\t\tif err := machineUtil.GenerateCACertificate(caCertPath, caKeyPath, NAME, BITS); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tcaCert, err := ioutil.ReadFile(caCertPath)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tcaKey, err := ioutil.ReadFile(caKeyPath)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\t// caCertPath, caKeyPath are already written to by machineUtil.GenerateCACertificate()\n\t\tif err := config.Set(\"rancher.docker.ca_cert\", string(caCert)); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif err := config.Set(\"rancher.docker.ca_key\", string(caKey)); err != nil {\n\t\t\treturn err\n\t\t}\n\t} else {\n\t\tcfg = config.LoadConfig()\n\n\t\tif err := util.WriteFileAtomic(caCertPath, []byte(cfg.Rancher.Docker.CACert), 0400); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif err := util.WriteFileAtomic(caKeyPath, []byte(cfg.Rancher.Docker.CAKey), 0400); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc tlsConfCreate(c *cli.Context) error {\n\terr := generate(c)\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\treturn nil\n}\n\nfunc generate(c *cli.Context) error {\n\tgenerateServer := c.Bool(\"server\")\n\toutDir := c.String(\"dir\")\n\thostnames := c.StringSlice(\"hostname\")\n\n\treturn Generate(generateServer, outDir, hostnames)\n}\n\nfunc Generate(generateServer bool, outDir string, hostnames []string) error {\n\tif outDir == \"\" {\n\t\tif generateServer {\n\t\t\toutDir = ServerTLSPath\n\t\t} else {\n\t\t\toutDir = ClientTLSPath\n\t\t}\n\t\tlog.Infof(\"Out directory (-d, --dir) not specified, using default: %s\", outDir)\n\t}\n\tcaCertPath := filepath.Join(outDir, CaCert)\n\tcaKeyPath := filepath.Join(outDir, CaKey)\n\tcertPath := filepath.Join(outDir, Cert)\n\tkeyPath := filepath.Join(outDir, Key)\n\n\tif generateServer {\n\t\tcertPath = filepath.Join(outDir, ServerCert)\n\t\tkeyPath = filepath.Join(outDir, ServerKey)\n\t}\n\n\tif _, err := os.Stat(outDir); os.IsNotExist(err) {\n\t\tif err := os.MkdirAll(outDir, 0700); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tcfg := config.LoadConfig()\n\tif err := writeCaCerts(cfg, caCertPath, caKeyPath); err != nil {\n\t\treturn err\n\t}\n\tif err := writeCerts(generateServer, hostnames, certPath, keyPath, caCertPath, caKeyPath); err != nil {\n\t\treturn err\n\t}\n\n\tif !generateServer {\n\t\tif err := filepath.Walk(outDir, func(path string, info os.FileInfo, err error) error {\n\t\t\treturn os.Chown(path, 1100, 1100) // rancher:rancher\n\t\t}); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/control/udevsettle.go", "content": "package control\n\nimport (\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nfunc udevSettleAction(c *cli.Context) {\n\tif err := extraRules(); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif err := UdevSettle(); err != nil {\n\t\tlog.Fatal(err)\n\t}\n}\n\nfunc extraRules() error {\n\tcfg := config.LoadConfig()\n\tif len(cfg.Rancher.Network.ModemNetworks) > 0 {\n\t\trules, err := ioutil.ReadDir(config.UdevRulesExtrasDir)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tfor _, r := range rules {\n\t\t\tif r.IsDir() || filepath.Ext(r.Name()) != \".rules\" {\n\t\t\t\tcontinue\n\t\t\t}\n\t\t\terr := os.Symlink(filepath.Join(config.UdevRulesExtrasDir, r.Name()), filepath.Join(config.UdevRulesDir, r.Name()))\n\t\t\tif err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\t} else {\n\t\trules, err := ioutil.ReadDir(config.UdevRulesDir)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tfor _, r := range rules {\n\t\t\tif r.IsDir() || (filepath.Ext(r.Name()) != \".rules\") || (r.Mode()&os.ModeSymlink != 0) {\n\t\t\t\tcontinue\n\t\t\t}\n\t\t\terr := os.Remove(filepath.Join(config.UdevRulesDir, r.Name()))\n\t\t\tif err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\t}\n\treturn nil\n}\n\nfunc UdevSettle() error {\n\tcmd := exec.Command(\"udevd\", \"--daemon\")\n\tdefer exec.Command(\"killall\", \"udevd\").Run()\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\treturn err\n\t}\n\n\tcmd = exec.Command(\"udevadm\", \"trigger\", \"--action=add\")\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\tif err := cmd.Run(); err != nil {\n\t\treturn err\n\t}\n\n\tcmd = exec.Command(\"udevadm\", \"settle\")\n\tcmd.Stdout = os.Stdout\n\tcmd.Stderr = os.Stderr\n\treturn cmd.Run()\n}\n" }, { "path": "cmd/control/user_docker.go", "content": "package control\n\nimport (\n\t\"io\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"path\"\n\t\"path/filepath\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/compose\"\n\trosDocker \"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/codegangsta/cli\"\n\tcomposeClient \"github.com/docker/libcompose/docker/client\"\n\t\"github.com/docker/libcompose/project\"\n\t\"golang.org/x/net/context\"\n)\n\nconst (\n\tdefaultStorageContext = \"console\"\n\tdockerPidFile = \"/var/run/docker.pid\"\n\tsourceDirectory = \"/engine\"\n\tdestDirectory = \"/var/lib/rancher/engine\"\n\tpluginsSourceDirectory = \"/engine-plugins\"\n\tpluginsDestDirectory = \"/var/lib/rancher/engine-plugins\"\n\tdockerCompletionFName = \"completion\"\n)\n\nvar (\n\tdockerCommand = []string{\n\t\t\"ros\",\n\t\t\"docker-init\",\n\t}\n)\n\nfunc userDockerAction(c *cli.Context) error {\n\tif err := copyBinaries(sourceDirectory, destDirectory); err != nil {\n\t\treturn err\n\t}\n\n\tif err := copyBinaries(pluginsSourceDirectory, pluginsDestDirectory); err != nil {\n\t\treturn err\n\t}\n\n\tif err := syscall.Mount(\"/host/sys\", \"/sys\", \"\", syscall.MS_BIND|syscall.MS_REC, \"\"); err != nil {\n\t\treturn err\n\t}\n\n\tcfg := config.LoadConfig()\n\n\treturn startDocker(cfg)\n}\n\nfunc copyBinaries(source, dest string) error {\n\tif err := os.MkdirAll(dest, 0755); err != nil {\n\t\treturn err\n\t}\n\n\tfiles, err := ioutil.ReadDir(dest)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor _, file := range files {\n\t\tif err = os.RemoveAll(path.Join(dest, file.Name())); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tfiles, err = ioutil.ReadDir(source)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor _, file := range files {\n\t\tsourceFile := path.Join(source, file.Name())\n\t\tdestFile := path.Join(dest, file.Name())\n\n\t\tin, err := os.Open(sourceFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tout, err := os.Create(destFile)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif _, err = io.Copy(out, in); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif err = out.Sync(); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif err = in.Close(); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif err = out.Close(); err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif file.Name() == dockerCompletionFName {\n\t\t\tif err := os.Chmod(destFile, 0644); err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t} else {\n\t\t\tif err := os.Chmod(destFile, 0751); err != nil {\n\t\t\t\treturn err\n\t\t\t}\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc writeConfigCerts(cfg *config.CloudConfig) error {\n\toutDir := ServerTLSPath\n\tif err := os.MkdirAll(outDir, 0700); err != nil {\n\t\treturn err\n\t}\n\tcaCertPath := filepath.Join(outDir, CaCert)\n\tcaKeyPath := filepath.Join(outDir, CaKey)\n\tserverCertPath := filepath.Join(outDir, ServerCert)\n\tserverKeyPath := filepath.Join(outDir, ServerKey)\n\tif cfg.Rancher.Docker.CACert != \"\" {\n\t\tif err := util.WriteFileAtomic(caCertPath, []byte(cfg.Rancher.Docker.CACert), 0400); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif err := util.WriteFileAtomic(caKeyPath, []byte(cfg.Rancher.Docker.CAKey), 0400); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\tif cfg.Rancher.Docker.ServerCert != \"\" {\n\t\tif err := util.WriteFileAtomic(serverCertPath, []byte(cfg.Rancher.Docker.ServerCert), 0400); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\tif err := util.WriteFileAtomic(serverKeyPath, []byte(cfg.Rancher.Docker.ServerKey), 0400); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\treturn nil\n}\n\nfunc startDocker(cfg *config.CloudConfig) error {\n\tstorageContext := cfg.Rancher.Docker.StorageContext\n\tif storageContext == \"\" {\n\t\tstorageContext = defaultStorageContext\n\t}\n\n\tlog.Infof(\"Starting Docker in context: %s\", storageContext)\n\n\tp, err := compose.GetProject(cfg, true, false)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tpid, err := waitForPid(storageContext, p)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tlog.Infof(\"%s PID %d\", storageContext, pid)\n\n\tclient, err := rosDocker.NewSystemClient()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tdockerCfg := cfg.Rancher.Docker\n\n\targs := dockerCfg.FullArgs()\n\n\tlog.Debugf(\"User Docker args: %v\", args)\n\n\tif dockerCfg.TLS {\n\t\tif err := writeConfigCerts(cfg); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tinfo, err := client.ContainerInspect(context.Background(), storageContext)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcmd := []string{\"system-docker-runc\", \"exec\", \"--\", info.ID, \"env\"}\n\tlog.Info(dockerCfg.AppendEnv())\n\tcmd = append(cmd, dockerCfg.AppendEnv()...)\n\tcmd = append(cmd, dockerCommand...)\n\tcmd = append(cmd, args...)\n\tlog.Infof(\"Running %v\", cmd)\n\n\treturn syscall.Exec(\"/usr/bin/system-docker-runc\", cmd, os.Environ())\n}\n\nfunc waitForPid(service string, project *project.Project) (int, error) {\n\tlog.Infof(\"Getting PID for service: %s\", service)\n\tfor {\n\t\tif pid, err := getPid(service, project); err != nil || pid == 0 {\n\t\t\tlog.Infof(\"Waiting for %s : %d : %v\", service, pid, err)\n\t\t\ttime.Sleep(1 * time.Second)\n\t\t} else {\n\t\t\treturn pid, err\n\t\t}\n\t}\n}\n\nfunc getPid(service string, project *project.Project) (int, error) {\n\ts, err := project.CreateService(service)\n\tif err != nil {\n\t\treturn 0, err\n\t}\n\n\tcontainers, err := s.Containers(context.Background())\n\tif err != nil {\n\t\treturn 0, err\n\t}\n\n\tif len(containers) == 0 {\n\t\treturn 0, nil\n\t}\n\n\tclient, err := composeClient.Create(composeClient.Options{\n\t\tHost: config.SystemDockerHost,\n\t})\n\tif err != nil {\n\t\treturn 0, err\n\t}\n\n\tid, err := containers[0].ID()\n\tif err != nil {\n\t\treturn 0, err\n\t}\n\n\tinfo, err := client.ContainerInspect(context.Background(), id)\n\tif err != nil || info.ID == \"\" {\n\t\treturn 0, err\n\t}\n\n\tif info.State.Running {\n\t\treturn info.State.Pid, nil\n\t}\n\n\treturn 0, nil\n}\n" }, { "path": "cmd/control/util.go", "content": "package control\n\nimport (\n\t\"bufio\"\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"strings\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/pkg/errors\"\n)\n\nfunc yes(question string) bool {\n\tfmt.Printf(\"%s [y/N]: \", question)\n\tin := bufio.NewReader(os.Stdin)\n\tline, err := in.ReadString('\\n')\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\treturn strings.ToLower(line[0:1]) == \"y\"\n}\n\nfunc formatImage(image string, cfg *config.CloudConfig) string {\n\tdomainRegistry := cfg.Rancher.Environment[\"REGISTRY_DOMAIN\"]\n\tif domainRegistry != \"docker.io\" && domainRegistry != \"\" {\n\t\treturn fmt.Sprintf(\"%s/%s\", domainRegistry, image)\n\t}\n\treturn image\n}\n\nfunc symLinkEngineBinary() []symlink {\n\tbaseSymlink := []symlink{\n\t\t{\"/usr/share/ros/os-release\", \"/usr/lib/os-release\"},\n\t\t{\"/usr/share/ros/os-release\", \"/etc/os-release\"},\n\n\t\t{\"/var/lib/rancher/engine/docker\", \"/usr/bin/docker\"},\n\t\t{\"/var/lib/rancher/engine/dockerd\", \"/usr/bin/dockerd\"},\n\t\t{\"/var/lib/rancher/engine/docker-init\", \"/usr/bin/docker-init\"},\n\t\t{\"/var/lib/rancher/engine/docker-proxy\", \"/usr/bin/docker-proxy\"},\n\n\t\t// >= 18.09.0\n\t\t{\"/var/lib/rancher/engine/containerd\", \"/usr/bin/containerd\"},\n\t\t{\"/var/lib/rancher/engine/ctr\", \"/usr/bin/ctr\"},\n\t\t{\"/var/lib/rancher/engine/containerd-shim\", \"/usr/bin/containerd-shim\"},\n\t\t{\"/var/lib/rancher/engine/runc\", \"/usr/bin/runc\"},\n\n\t\t// < 18.09.0\n\t\t{\"/var/lib/rancher/engine/docker-containerd\", \"/usr/bin/docker-containerd\"},\n\t\t{\"/var/lib/rancher/engine/docker-containerd-ctr\", \"/usr/bin/docker-containerd-ctr\"},\n\t\t{\"/var/lib/rancher/engine/docker-containerd-shim\", \"/usr/bin/docker-containerd-shim\"},\n\t\t{\"/var/lib/rancher/engine/docker-runc\", \"/usr/bin/docker-runc\"},\n\n\t\t// Docker CLI plugins\n\t\t{\"/var/lib/rancher/engine-plugins/docker-compose\", \"/usr/bin/docker-compose\"},\n\t\t{\"/var/lib/rancher/engine-plugins/docker-compose\", \"/usr/libexec/docker/cli-plugins/docker-compose\"},\n\t\t{\"/var/lib/rancher/engine-plugins/docker-buildx\", \"/usr/libexec/docker/cli-plugins/docker-buildx\"},\n\t}\n\treturn baseSymlink\n}\n\nfunc checkZfsBackingFS(driver, dir string) error {\n\tif driver != \"zfs\" {\n\t\treturn nil\n\t}\n\tfor i := 0; i < 4; i++ {\n\t\tmountInfo, err := ioutil.ReadFile(\"/proc/self/mountinfo\")\n\t\tif err != nil {\n\t\t\tcontinue\n\t\t}\n\t\tfor _, mount := range strings.Split(string(mountInfo), \"\\n\") {\n\t\t\tif strings.Contains(mount, dir) && strings.Contains(mount, driver) {\n\t\t\t\treturn nil\n\t\t\t}\n\t\t}\n\t\ttime.Sleep(1 * time.Second)\n\t}\n\treturn errors.Errorf(\"BackingFS: %s not match storage-driver: %s\", dir, driver)\n}\n\nfunc checkGlobalCfg() bool {\n\t_, err := os.Stat(\"/proc/1/root/boot/global.cfg\")\n\tif err == nil || os.IsExist(err) {\n\t\treturn true\n\t}\n\treturn false\n}\n" }, { "path": "cmd/init/init.go", "content": "//go:build linux\n// +build linux\n\npackage init\n\nimport (\n\t\"fmt\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/dfs\"\n\t\"github.com/burmilla/os/pkg/init/b2d\"\n\t\"github.com/burmilla/os/pkg/init/cloudinit\"\n\t\"github.com/burmilla/os/pkg/init/configfiles\"\n\t\"github.com/burmilla/os/pkg/init/debug\"\n\t\"github.com/burmilla/os/pkg/init/docker\"\n\t\"github.com/burmilla/os/pkg/init/env\"\n\t\"github.com/burmilla/os/pkg/init/fsmount\"\n\t\"github.com/burmilla/os/pkg/init/hypervisor\"\n\t\"github.com/burmilla/os/pkg/init/modules\"\n\t\"github.com/burmilla/os/pkg/init/one\"\n\t\"github.com/burmilla/os/pkg/init/prepare\"\n\t\"github.com/burmilla/os/pkg/init/recovery\"\n\t\"github.com/burmilla/os/pkg/init/sharedroot\"\n\t\"github.com/burmilla/os/pkg/init/switchroot\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/sysinit\"\n)\n\nfunc MainInit() {\n\tlog.InitLogger()\n\t// TODO: this breaks and does nothing if the cfg is invalid (or is it due to threading?)\n\tdefer func() {\n\t\tif r := recover(); r != nil {\n\t\t\tfmt.Printf(\"Starting Recovery console: %v\\n\", r)\n\t\t\trecovery.Recovery(nil)\n\t\t}\n\t}()\n\n\tif err := RunInit(); err != nil {\n\t\tlog.Fatal(err)\n\t}\n}\n\nfunc RunInit() error {\n\tinitFuncs := config.CfgFuncs{\n\t\t{Name: \"set env\", Func: env.Init},\n\t\t{Name: \"preparefs\", Func: prepare.FS},\n\t\t{Name: \"save init cmdline\", Func: prepare.SaveCmdline},\n\t\t{Name: \"mount OEM\", Func: fsmount.MountOem},\n\t\t{Name: \"debug save cfg\", Func: debug.PrintAndLoadConfig},\n\t\t{Name: \"load modules\", Func: modules.LoadModules},\n\t\t{Name: \"recovery console\", Func: recovery.LoadRecoveryConsole},\n\t\t{Name: \"b2d env\", Func: b2d.B2D},\n\t\t{Name: \"mount STATE and bootstrap\", Func: fsmount.MountStateAndBootstrap},\n\t\t{Name: \"cloud-init\", Func: cloudinit.CloudInit},\n\t\t{Name: \"read cfg and log files\", Func: configfiles.ReadConfigFiles},\n\t\t{Name: \"switchroot\", Func: switchroot.SwitchRoot},\n\t\t{Name: \"mount OEM2\", Func: fsmount.MountOem},\n\t\t{Name: \"mount BOOT\", Func: fsmount.MountBoot},\n\t\t{Name: \"write cfg and log files\", Func: configfiles.WriteConfigFiles},\n\t\t{Name: \"b2d Env\", Func: b2d.Env},\n\t\t{Name: \"hypervisor tools\", Func: hypervisor.Tools},\n\t\t{Name: \"preparefs2\", Func: prepare.FS},\n\t\t{Name: \"load modules2\", Func: modules.LoadModules},\n\t\t{Name: \"set proxy env\", Func: env.Proxy},\n\t\t{Name: \"setupSharedRoot\", Func: sharedroot.Setup},\n\t\t{Name: \"sysinit\", Func: sysinit.RunSysInit},\n\t}\n\n\tcfg, err := config.ChainCfgFuncs(nil, initFuncs)\n\tif err != nil {\n\t\trecovery.Recovery(err)\n\t}\n\n\tlaunchConfig, args := docker.GetLaunchConfig(cfg, &cfg.Rancher.SystemDocker)\n\tlaunchConfig.Fork = !cfg.Rancher.SystemDocker.Exec\n\t//launchConfig.NoLog = true\n\n\tlog.Info(\"Launching System Docker\")\n\t_, err = dfs.LaunchDocker(launchConfig, config.SystemDockerBin, args...)\n\tif err != nil {\n\t\tlog.Errorf(\"Error Launching System Docker: %s\", err)\n\t\trecovery.Recovery(err)\n\t\treturn err\n\t}\n\t// Code never gets here - rancher.system_docker.exec=true\n\n\treturn one.PidOne()\n}\n" }, { "path": "cmd/network/network.go", "content": "package network\n\nimport (\n\t\"fmt\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/signal\"\n\t\"path/filepath\"\n\t\"strconv\"\n\t\"syscall\"\n\t\"text/template\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/hostname\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/netconf\"\n\n\t\"github.com/docker/libnetwork/resolvconf\"\n\t\"golang.org/x/net/context\"\n)\n\nvar funcMap = template.FuncMap{\n\t\"addFunc\": func(a, b int) string {\n\t\treturn strconv.Itoa(a + b)\n\t},\n}\n\nfunc Main() {\n\tlog.InitLogger()\n\n\tcfg := config.LoadConfig()\n\tApplyNetworkConfig(cfg)\n\n\tlog.Infof(\"Restart syslog\")\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tif err := client.ContainerRestart(context.Background(), \"syslog\", 10); err != nil {\n\t\tlog.Error(err)\n\t}\n\n\tsignalChan := make(chan os.Signal, 1)\n\tsignal.Notify(signalChan, syscall.SIGTERM)\n\t<-signalChan\n\tlog.Info(\"Received SIGTERM, shutting down\")\n\tnetconf.StopWpaSupplicant()\n\tnetconf.StopDhcpcd()\n}\n\nfunc ApplyNetworkConfig(cfg *config.CloudConfig) {\n\tlog.Infof(\"Apply Network Config\")\n\tuserSetDNS := len(cfg.Rancher.Network.DNS.Nameservers) > 0 || len(cfg.Rancher.Network.DNS.Search) > 0\n\n\tif err := hostname.SetHostnameFromCloudConfig(cfg); err != nil {\n\t\tlog.Errorf(\"Failed to set hostname from cloud config: %v\", err)\n\t}\n\n\tuserSetHostname := cfg.Hostname != \"\"\n\tif cfg.Rancher.Network.DHCPTimeout <= 0 {\n\t\tcfg.Rancher.Network.DHCPTimeout = cfg.Rancher.Defaults.Network.DHCPTimeout\n\t}\n\n\t// Always generate dhcpcd.conf to support NTP and hostname configuration coming from DHCP\n\tgenerateDhcpcdFiles(cfg)\n\n\t// In order to handle the STATIC mode in Wi-Fi network, we have to update the dhcpcd.conf file.\n\t// https://wiki.archlinux.org/index.php/dhcpcd#Static_profile\n\tif len(cfg.Rancher.Network.WifiNetworks) > 0 {\n\t\tgenerateWpaFiles(cfg)\n\t}\n\n\tdhcpSetDNS, err := netconf.ApplyNetworkConfigs(&cfg.Rancher.Network, userSetHostname, userSetDNS)\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to apply network configs(by netconf): %v\", err)\n\t}\n\n\tif dhcpSetDNS {\n\t\tlog.Infof(\"DNS set by DHCP\")\n\t}\n\n\tif !userSetDNS && !dhcpSetDNS {\n\t\t// only write 8.8.8.8,8.8.4.4 as a last resort\n\t\tlog.Infof(\"Writing default resolv.conf - no user setting, and no DHCP setting\")\n\t\tif _, err := resolvconf.Build(\"/etc/resolv.conf\",\n\t\t\tcfg.Rancher.Defaults.Network.DNS.Nameservers,\n\t\t\tcfg.Rancher.Defaults.Network.DNS.Search,\n\t\t\tnil); err != nil {\n\t\t\tlog.Errorf(\"Failed to write resolv.conf (!userSetDNS and !dhcpSetDNS): %v\", err)\n\t\t}\n\t}\n\tif userSetDNS {\n\t\tif _, err := resolvconf.Build(\"/etc/resolv.conf\", cfg.Rancher.Network.DNS.Nameservers, cfg.Rancher.Network.DNS.Search, nil); err != nil {\n\t\t\tlog.Errorf(\"Failed to write resolv.conf (userSetDNS): %v\", err)\n\t\t} else {\n\t\t\tlog.Infof(\"writing to /etc/resolv.conf: nameservers: %v, search: %v\", cfg.Rancher.Network.DNS.Nameservers, cfg.Rancher.Network.DNS.Search)\n\t\t}\n\t}\n\n\tresolve, err := ioutil.ReadFile(\"/etc/resolv.conf\")\n\tlog.Debugf(\"Resolve.conf == [%s], %v\", resolve, err)\n\n\tlog.Infof(\"Apply Network Config SyncHostname\")\n\tif err := hostname.SyncHostname(); err != nil {\n\t\tlog.Errorf(\"Failed to sync hostname: %v\", err)\n\t}\n}\n\nfunc generateDhcpcdFiles(cfg *config.CloudConfig) {\n\tnetworks := cfg.Rancher.Network.WifiNetworks\n\tinterfaces := cfg.Rancher.Network.Interfaces\n\tconfigs := make(map[string]netconf.WifiNetworkConfig)\n\tfor k, v := range interfaces {\n\t\tif c, ok := networks[v.WifiNetwork]; ok && c.Address != \"\" {\n\t\t\tconfigs[k] = c\n\t\t}\n\t}\n\tf, err := os.Create(config.DHCPCDConfigFile)\n\tdefer f.Close()\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to open file: %s err: %v\", config.DHCPCDConfigFile, err)\n\t}\n\ttemplateFiles := []string{config.DHCPCDTemplateFile}\n\ttemplateName := filepath.Base(templateFiles[0])\n\tp := template.Must(template.New(templateName).ParseFiles(templateFiles...))\n\tif err = p.Execute(f, configs); err != nil {\n\t\tlog.Errorf(\"Failed to wrote wpa configuration to %s: %v\", config.DHCPCDConfigFile, err)\n\t}\n}\n\nfunc generateWpaFiles(cfg *config.CloudConfig) {\n\tnetworks := cfg.Rancher.Network.WifiNetworks\n\tinterfaces := cfg.Rancher.Network.Interfaces\n\tfor k, v := range interfaces {\n\t\tif v.WifiNetwork != \"\" {\n\t\t\tconfigs := make(map[string]netconf.WifiNetworkConfig)\n\t\t\tfilename := fmt.Sprintf(config.WPAConfigFile, k)\n\t\t\tf, err := os.Create(filename)\n\t\t\tif err != nil {\n\t\t\t\tlog.Errorf(\"Failed to open file: %s err: %v\", filename, err)\n\t\t\t}\n\t\t\tif c, ok := networks[v.WifiNetwork]; ok {\n\t\t\t\tconfigs[v.WifiNetwork] = c\n\t\t\t}\n\t\t\ttemplateFiles := []string{config.WPATemplateFile}\n\t\t\ttemplateName := filepath.Base(templateFiles[0])\n\t\t\tp := template.Must(template.New(templateName).Funcs(funcMap).ParseFiles(templateFiles...))\n\t\t\tif err = p.Execute(f, configs); err != nil {\n\t\t\t\tlog.Errorf(\"Failed to wrote wpa configuration to %s: %v\", filename, err)\n\t\t\t}\n\t\t\tf.Close()\n\t\t}\n\t}\n}\n" }, { "path": "cmd/power/power.go", "content": "package power\n\nimport (\n\t\"errors\"\n\t\"fmt\"\n\t\"os\"\n\t\"path/filepath\"\n\t\"strconv\"\n\t\"strings\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/cmd/control/install\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/util\"\n\n\t\"github.com/docker/engine-api/types\"\n\t\"github.com/docker/engine-api/types/container\"\n\t\"github.com/docker/engine-api/types/filters\"\n\t\"golang.org/x/net/context\"\n)\n\n// You can't shutdown the system from a process in console because we want to stop the console container.\n// If you do that you kill yourself. So we spawn a separate container to do power operations\n// This can up because on shutdown we want ssh to gracefully die, terminating ssh connections and not just hanging tcp session\n//\n// Be careful of container name. only [a-zA-Z0-9][a-zA-Z0-9_.-] are allowed\nfunc runDocker(name string) error {\n\tif os.ExpandEnv(\"${IN_DOCKER}\") == \"true\" {\n\t\treturn nil\n\t}\n\n\tclient, err := docker.NewSystemClient()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcmd := os.Args\n\tlog.Debugf(\"runDocker cmd: %s\", cmd)\n\n\tif name == \"\" {\n\t\tname = filepath.Base(os.Args[0])\n\t}\n\n\tcontainerName := strings.TrimPrefix(strings.Join(strings.Split(name, \"/\"), \"-\"), \"-\")\n\n\texisting, err := client.ContainerInspect(context.Background(), containerName)\n\tif err == nil && existing.ID != \"\" {\n\t\t// remove the old version of reboot\n\t\terr := client.ContainerRemove(context.Background(), types.ContainerRemoveOptions{\n\t\t\tContainerID: existing.ID,\n\t\t})\n\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\tcurrentContainerID, err := util.GetCurrentContainerID()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcurrentContainer, err := client.ContainerInspect(context.Background(), currentContainerID)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tpowerContainer, err := client.ContainerCreate(context.Background(),\n\t\t&container.Config{\n\t\t\tImage: currentContainer.Config.Image,\n\t\t\tCmd: cmd,\n\t\t\tEnv: []string{\n\t\t\t\t\"IN_DOCKER=true\",\n\t\t\t},\n\t\t},\n\t\t&container.HostConfig{\n\t\t\tPidMode: \"host\",\n\t\t\tNetworkMode: \"none\",\n\t\t\tVolumesFrom: []string{\n\t\t\t\tcurrentContainer.ID,\n\t\t\t},\n\t\t\tPrivileged: true,\n\t\t}, nil, containerName)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\terr = client.ContainerStart(context.Background(), powerContainer.ID)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treader, err := client.ContainerLogs(context.Background(), types.ContainerLogsOptions{\n\t\tContainerID: powerContainer.ID,\n\t\tShowStderr: true,\n\t\tShowStdout: true,\n\t\tFollow: true,\n\t})\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tfor {\n\t\tp := make([]byte, 4096)\n\t\tn, err := reader.Read(p)\n\t\tif err != nil {\n\t\t\tlog.Error(err)\n\t\t\tif n == 0 {\n\t\t\t\treader.Close()\n\t\t\t\tbreak\n\t\t\t}\n\t\t}\n\t\tif n > 0 {\n\t\t\tfmt.Print(string(p))\n\t\t}\n\t}\n\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n\n\tos.Exit(0)\n\treturn nil\n}\n\nfunc reboot(name string, force bool, code uint) {\n\tif os.Geteuid() != 0 {\n\t\tlog.Fatalf(\"%s: Need to be root\", os.Args[0])\n\t}\n\n\tcfg := config.LoadConfig()\n\n\t// Validate config\n\tif !force {\n\t\t_, validationErrors, err := config.LoadConfigWithError()\n\t\tif err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t\tif validationErrors != nil && !validationErrors.Valid() {\n\t\t\tfor _, validationError := range validationErrors.Errors() {\n\t\t\t\tlog.Error(validationError)\n\t\t\t}\n\t\t\treturn\n\t\t}\n\t}\n\n\t// Add shutdown timeout\n\ttimeoutValue := cfg.Rancher.ShutdownTimeout\n\tif timeoutValue == 0 {\n\t\ttimeoutValue = 60\n\t}\n\tif timeoutValue < 5 {\n\t\ttimeoutValue = 5\n\t}\n\tlog.Infof(\"Setting %s timeout to %d (rancher.shutdown_timeout set to %d)\", os.Args[0], timeoutValue, cfg.Rancher.ShutdownTimeout)\n\n\tgo func() {\n\t\ttimeout := time.After(time.Duration(timeoutValue) * time.Second)\n\t\ttick := time.Tick(100 * time.Millisecond)\n\t\t// Keep trying until we're timed out or got a result or got an error\n\t\tfor {\n\t\t\tselect {\n\t\t\t// Got a timeout! fail with a timeout error\n\t\t\tcase <-timeout:\n\t\t\t\tlog.Errorf(\"Container shutdown taking too long, forcing %s.\", os.Args[0])\n\t\t\t\tsyscall.Sync()\n\t\t\t\tsyscall.Reboot(int(code))\n\t\t\tcase <-tick:\n\t\t\t\tfmt.Printf(\".\")\n\t\t\t}\n\t\t}\n\t}()\n\n\t// reboot -f should work even when system-docker is having problems\n\tif !force {\n\t\tif kexecFlag || previouskexecFlag || kexecAppendFlag != \"\" {\n\t\t\t// pass through the cmdline args\n\t\t\tname = \"\"\n\t\t}\n\t\tif err := runDocker(name); err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\tif kexecFlag || previouskexecFlag || kexecAppendFlag != \"\" {\n\t\t// need to mount boot dir, or `system-docker run -v /:/host -w /host/boot` ?\n\t\tbaseName := \"/mnt/new_img\"\n\t\t_, _, err := install.MountDevice(baseName, \"\", \"\", false)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"ERROR: can't Kexec: %s\", err)\n\t\t\treturn\n\t\t}\n\t\tdefer util.Unmount(baseName)\n\t\tKexec(previouskexecFlag, filepath.Join(baseName, config.BootDir), kexecAppendFlag)\n\t\treturn\n\t}\n\n\tif !force {\n\t\terr := shutDownContainers()\n\t\tif err != nil {\n\t\t\tlog.Error(err)\n\t\t}\n\t}\n\n\tsyscall.Sync()\n\terr := syscall.Reboot(int(code))\n\tif err != nil {\n\t\tlog.Fatal(err)\n\t}\n}\n\nfunc shutDownContainers() error {\n\tvar err error\n\tshutDown := true\n\ttimeout := 2\n\tfor i, arg := range os.Args {\n\t\tif arg == \"-f\" || arg == \"--f\" || arg == \"--force\" {\n\t\t\tshutDown = false\n\t\t}\n\t\tif arg == \"-t\" || arg == \"--t\" || arg == \"--timeout\" {\n\t\t\tif len(os.Args) > i+1 {\n\t\t\t\tt, err := strconv.Atoi(os.Args[i+1])\n\t\t\t\tif err != nil {\n\t\t\t\t\treturn err\n\t\t\t\t}\n\t\t\t\ttimeout = t\n\t\t\t} else {\n\t\t\t\tlog.Error(\"please specify a timeout\")\n\t\t\t}\n\t\t}\n\t}\n\tif !shutDown {\n\t\treturn nil\n\t}\n\tclient, err := docker.NewSystemClient()\n\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfilter := filters.NewArgs()\n\tfilter.Add(\"status\", \"running\")\n\n\topts := types.ContainerListOptions{\n\t\tAll: true,\n\t\tFilter: filter,\n\t}\n\n\tcontainers, err := client.ContainerList(context.Background(), opts)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcurrentContainerID, err := util.GetCurrentContainerID()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tvar stopErrorStrings []string\n\tconsoleContainerIdx := -1\n\n\tfor idx, container := range containers {\n\t\tif container.ID == currentContainerID {\n\t\t\tcontinue\n\t\t}\n\t\tif container.Names[0] == \"/console\" {\n\t\t\tconsoleContainerIdx = idx\n\t\t\tcontinue\n\t\t}\n\n\t\tlog.Infof(\"Stopping %s : %s\", container.Names[0], container.ID[:12])\n\t\tstopErr := client.ContainerStop(context.Background(), container.ID, timeout)\n\t\tif stopErr != nil {\n\t\t\tlog.Errorf(\"------- Error Stopping %s : %s\", container.Names[0], stopErr.Error())\n\t\t\tstopErrorStrings = append(stopErrorStrings, \" [\"+container.ID+\"] \"+stopErr.Error())\n\t\t}\n\t}\n\n\t// lets see what containers are still running and only wait on those\n\tcontainers, err = client.ContainerList(context.Background(), opts)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tvar waitErrorStrings []string\n\n\tfor idx, container := range containers {\n\t\tif container.ID == currentContainerID {\n\t\t\tcontinue\n\t\t}\n\t\tif container.Names[0] == \"/console\" {\n\t\t\tconsoleContainerIdx = idx\n\t\t\tcontinue\n\t\t}\n\t\tlog.Infof(\"Waiting %s : %s\", container.Names[0], container.ID[:12])\n\t\t_, waitErr := client.ContainerWait(context.Background(), container.ID)\n\t\tif waitErr != nil {\n\t\t\tlog.Errorf(\"------- Error Waiting %s : %s\", container.Names[0], waitErr.Error())\n\t\t\twaitErrorStrings = append(waitErrorStrings, \" [\"+container.ID+\"] \"+waitErr.Error())\n\t\t}\n\t}\n\n\t// and now stop the console\n\tif consoleContainerIdx != -1 {\n\t\tcontainer := containers[consoleContainerIdx]\n\t\tlog.Infof(\"Console Stopping %v : %s\", container.Names, container.ID[:12])\n\t\tstopErr := client.ContainerStop(context.Background(), container.ID, timeout)\n\t\tif stopErr != nil {\n\t\t\tlog.Errorf(\"------- Error Stopping %v : %s\", container.Names, stopErr.Error())\n\t\t\tstopErrorStrings = append(stopErrorStrings, \" [\"+container.ID+\"] \"+stopErr.Error())\n\t\t}\n\n\t\tlog.Infof(\"Console Waiting %v : %s\", container.Names, container.ID[:12])\n\t\t_, waitErr := client.ContainerWait(context.Background(), container.ID)\n\t\tif waitErr != nil {\n\t\t\tlog.Errorf(\"------- Error Waiting %v : %s\", container.Names, waitErr.Error())\n\t\t\twaitErrorStrings = append(waitErrorStrings, \" [\"+container.ID+\"] \"+waitErr.Error())\n\t\t}\n\t}\n\n\tif len(waitErrorStrings) != 0 || len(stopErrorStrings) != 0 {\n\t\treturn errors.New(\"error while stopping \\n1. STOP Errors [\" + strings.Join(stopErrorStrings, \",\") + \"] \\n2. WAIT Errors [\" + strings.Join(waitErrorStrings, \",\") + \"]\")\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/power/shutdown.go", "content": "package power\n\nimport (\n\t\"fmt\"\n\t\"os\"\n\t\"os/exec\"\n\t\"path/filepath\"\n\t\"syscall\"\n\n\t\"github.com/burmilla/os/cmd/control/install\"\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nvar (\n\thaltFlag bool\n\tpoweroffFlag bool\n\trebootFlag bool\n\tforceFlag bool\n\tkexecFlag bool\n\tpreviouskexecFlag bool\n\tkexecAppendFlag string\n)\n\nfunc Shutdown() {\n\tlog.InitLogger()\n\tapp := cli.NewApp()\n\n\tapp.Name = filepath.Base(os.Args[0])\n\tapp.Usage = fmt.Sprintf(\"%s BurmillaOS\\nbuilt: %s\", app.Name, config.BuildDate)\n\tapp.Version = config.Version\n\tapp.Author = \"Project Burmilla\\n\\tRancher Labs, Inc.\"\n\tapp.EnableBashCompletion = true\n\tapp.Action = shutdown\n\tapp.Flags = []cli.Flag{\n\t\t// --no-wall\n\t\t// Do not send wall message before halt, power-off,\n\t\t// reboot.\n\n\t\t// halt, poweroff, reboot ONLY\n\t\t// -f, --force\n\t\t// Force immediate halt, power-off, reboot. Do not\n\t\t// contact the init system.\n\t\tcli.BoolFlag{\n\t\t\tName: \"f, force\",\n\t\t\tUsage: \"Force immediate halt, power-off, reboot. Do not contact the init system.\",\n\t\t\tDestination: &forceFlag,\n\t\t},\n\n\t\t// -w, --wtmp-only\n\t\t// Only write wtmp shutdown entry, do not actually\n\t\t// halt, power-off, reboot.\n\n\t\t// -d, --no-wtmp\n\t\t// Do not write wtmp shutdown entry.\n\n\t\t// -n, --no-sync\n\t\t// Don't sync hard disks/storage media before halt,\n\t\t// power-off, reboot.\n\n\t\t// shutdown ONLY\n\t\t// -h\n\t\t// Equivalent to --poweroff, unless --halt is\n\t\t// specified.\n\n\t\t// -k\n\t\t// Do not halt, power-off, reboot, just write wall\n\t\t// message.\n\n\t\t// -c\n\t\t// Cancel a pending shutdown. This may be used\n\t\t// cancel the effect of an invocation of shutdown\n\t\t// with a time argument that is not \"+0\" or \"now\".\n\n\t}\n\t// -H, --halt\n\t// Halt the machine.\n\tif app.Name == \"halt\" {\n\t\tapp.Flags = append(app.Flags, cli.BoolTFlag{\n\t\t\tName: \"H, halt\",\n\t\t\tUsage: \"halt the machine\",\n\t\t\tDestination: &haltFlag,\n\t\t})\n\t} else {\n\t\tapp.Flags = append(app.Flags, cli.BoolFlag{\n\t\t\tName: \"H, halt\",\n\t\t\tUsage: \"halt the machine\",\n\t\t\tDestination: &haltFlag,\n\t\t})\n\t}\n\t// -P, --poweroff\n\t// Power-off the machine (the default for shutdown cmd).\n\tif app.Name == \"poweroff\" {\n\t\tapp.Flags = append(app.Flags, cli.BoolTFlag{\n\t\t\tName: \"P, poweroff\",\n\t\t\tUsage: \"poweroff the machine\",\n\t\t\tDestination: &poweroffFlag,\n\t\t})\n\t} else {\n\t\t// shutdown -h\n\t\t// Equivalent to --poweroff\n\t\tif app.Name == \"shutdown\" {\n\t\t\tapp.Flags = append(app.Flags, cli.BoolFlag{\n\t\t\t\tName: \"h\",\n\t\t\t\tUsage: \"poweroff the machine\",\n\t\t\t\tDestination: &poweroffFlag,\n\t\t\t})\n\t\t}\n\t\tapp.Flags = append(app.Flags, cli.BoolFlag{\n\t\t\tName: \"P, poweroff\",\n\t\t\tUsage: \"poweroff the machine\",\n\t\t\tDestination: &poweroffFlag,\n\t\t})\n\t}\n\t// -r, --reboot\n\t// Reboot the machine.\n\tif app.Name == \"reboot\" {\n\t\tapp.Flags = append(app.Flags, cli.BoolTFlag{\n\t\t\tName: \"r, reboot\",\n\t\t\tUsage: \"reboot after shutdown\",\n\t\t\tDestination: &rebootFlag,\n\t\t})\n\t\t// OR? maybe implement it as a `kexec` cli tool?\n\t\tapp.Flags = append(app.Flags, cli.BoolFlag{\n\t\t\tName: \"kexec\",\n\t\t\tUsage: \"kexec the default RancherOS cfg\",\n\t\t\tDestination: &kexecFlag,\n\t\t})\n\t\tapp.Flags = append(app.Flags, cli.BoolFlag{\n\t\t\tName: \"kexec-previous\",\n\t\t\tUsage: \"kexec the previous RancherOS cfg\",\n\t\t\tDestination: &previouskexecFlag,\n\t\t})\n\t\tapp.Flags = append(app.Flags, cli.StringFlag{\n\t\t\tName: \"kexec-append\",\n\t\t\tUsage: \"kexec using the specified kernel boot params (ignores global.cfg)\",\n\t\t\tDestination: &kexecAppendFlag,\n\t\t})\n\t} else {\n\t\tapp.Flags = append(app.Flags, cli.BoolFlag{\n\t\t\tName: \"r, reboot\",\n\t\t\tUsage: \"reboot after shutdown\",\n\t\t\tDestination: &rebootFlag,\n\t\t})\n\t}\n\t//TODO: add the time and msg flags...\n\tapp.HideHelp = true\n\n\tapp.Run(os.Args)\n}\n\nfunc Kexec(previous bool, bootDir, append string) error {\n\tcfg := \"linux-current.cfg\"\n\tif previous {\n\t\tcfg = \"linux-previous.cfg\"\n\t}\n\tcfgFile := filepath.Join(bootDir, cfg)\n\tvmlinuzFile, initrdFile, err := install.ReadSyslinuxCfg(cfgFile)\n\tif err != nil {\n\t\tlog.Errorf(\"%s\", err)\n\t\treturn err\n\t}\n\tglobalCfgFile := filepath.Join(bootDir, \"global.cfg\")\n\tif append == \"\" {\n\t\tappend, err = install.ReadGlobalCfg(globalCfgFile)\n\t\tif err != nil {\n\t\t\tlog.Errorf(\"%s\", err)\n\t\t\treturn err\n\t\t}\n\t}\n\t// TODO: read global.cfg if append == \"\"\n\t// kexec -l ${DIST}/vmlinuz --initrd=${DIST}/initrd --append=\"${kernelArgs} ${APPEND}\" -f\n\tcmd := exec.Command(\n\t\t\"kexec\",\n\t\t\"-l\", vmlinuzFile,\n\t\t\"--initrd\", initrdFile,\n\t\t\"--append\", append,\n\t\t\"-f\")\n\tlog.Debugf(\"Run(%#v)\", cmd)\n\tcmd.Stderr = os.Stderr\n\tif _, err := cmd.Output(); err != nil {\n\t\tlog.Errorf(\"Failed to kexec: %s\", err)\n\t\treturn err\n\t}\n\tlog.Infof(\"kexec'd to new install\")\n\treturn nil\n}\n\n// Reboot is used by installation / upgrade\n// TODO: add kexec option\nfunc Reboot() {\n\tos.Args = []string{\"reboot\"}\n\treboot(\"reboot\", false, syscall.LINUX_REBOOT_CMD_RESTART)\n}\n\nfunc shutdown(c *cli.Context) error {\n\t// the shutdown command's default is poweroff\n\tvar powerCmd uint\n\tpowerCmd = syscall.LINUX_REBOOT_CMD_POWER_OFF\n\tif rebootFlag {\n\t\tpowerCmd = syscall.LINUX_REBOOT_CMD_RESTART\n\t} else if poweroffFlag {\n\t\tpowerCmd = syscall.LINUX_REBOOT_CMD_POWER_OFF\n\t} else if haltFlag {\n\t\tpowerCmd = syscall.LINUX_REBOOT_CMD_HALT\n\t}\n\n\ttimeArg := c.Args().Get(0)\n\t// We may be called via an absolute path, so check that now and make sure we\n\t// don't pass the wrong app name down. Aside from the logic in the immediate\n\t// context here, the container name is derived from how we were called and\n\t// cannot contain slashes.\n\tappName := filepath.Base(c.App.Name)\n\tif appName == \"shutdown\" && timeArg != \"\" {\n\t\tif timeArg != \"now\" && timeArg != \"+0\" {\n\t\t\terr := fmt.Errorf(\"Sorry, can't parse '%s' as time value (only 'now' supported)\", timeArg)\n\t\t\tlog.Error(err)\n\t\t\treturn err\n\t\t}\n\t\t// TODO: if there are more params, LOG them\n\t}\n\n\treboot(appName, forceFlag, powerCmd)\n\n\treturn nil\n}\n" }, { "path": "cmd/respawn/respawn.go", "content": "package respawn\n\nimport (\n\t\"fmt\"\n\t\"io\"\n\t\"io/ioutil\"\n\t\"os\"\n\t\"os/exec\"\n\t\"os/signal\"\n\t\"runtime\"\n\t\"strings\"\n\t\"sync\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/log\"\n\n\t\"github.com/codegangsta/cli\"\n)\n\nvar (\n\trunning = true\n\tprocesses = map[int]*os.Process{}\n\tprocessLock = sync.Mutex{}\n)\n\nfunc Main() {\n\tlog.InitLogger()\n\truntime.GOMAXPROCS(1)\n\truntime.LockOSThread()\n\tapp := cli.NewApp()\n\n\tapp.Name = os.Args[0]\n\tapp.Usage = fmt.Sprintf(\"%s BurmillaOS\\nbuilt: %s\", app.Name, config.BuildDate)\n\tapp.Version = config.Version\n\tapp.Author = \"Project Burmilla\\n\\tRancher Labs, Inc.\"\n\n\tapp.Flags = []cli.Flag{\n\t\tcli.StringFlag{\n\t\t\tName: \"file, f\",\n\t\t\tUsage: \"Optional config file to load\",\n\t\t},\n\t}\n\tapp.Action = run\n\n\tlog.Infof(\"%s, %s\", app.Usage, app.Version)\n\tfmt.Printf(\"%s, %s\", app.Usage, app.Version)\n\n\tapp.Run(os.Args)\n}\n\nfunc setupSigterm() {\n\tsigtermChan := make(chan os.Signal, 1)\n\tsignal.Notify(sigtermChan, syscall.SIGTERM)\n\tgo func() {\n\t\tfor range sigtermChan {\n\t\t\ttermPids()\n\t\t}\n\t}()\n}\n\nfunc run(c *cli.Context) error {\n\tsetupSigterm()\n\n\tvar stream io.Reader = os.Stdin\n\tvar err error\n\n\tinputFileName := c.String(\"file\")\n\n\tif inputFileName != \"\" {\n\t\tstream, err = os.Open(inputFileName)\n\t\tif err != nil {\n\t\t\tlog.Fatal(err)\n\t\t}\n\t}\n\n\tinput, err := ioutil.ReadAll(stream)\n\tif err != nil {\n\t\tpanic(err)\n\t}\n\n\tlines := strings.Split(string(input), \"\\n\")\n\tdoneChannel := make(chan string, len(lines))\n\n\tfor _, line := range lines {\n\t\tif strings.TrimSpace(line) == \"\" || strings.Index(strings.TrimSpace(line), \"#\") == 0 {\n\t\t\tcontinue\n\t\t}\n\t\tgo execute(line, doneChannel)\n\t}\n\n\tfor i := 0; i < len(lines); i++ {\n\t\tline := <-doneChannel\n\t\tlog.Infof(\"FINISHED: %s\", line)\n\t\tfmt.Printf(\"FINISHED: %s\", line)\n\t}\n\treturn nil\n}\n\nfunc addProcess(process *os.Process) {\n\tprocessLock.Lock()\n\tdefer processLock.Unlock()\n\tprocesses[process.Pid] = process\n}\n\nfunc removeProcess(process *os.Process) {\n\tprocessLock.Lock()\n\tdefer processLock.Unlock()\n\tdelete(processes, process.Pid)\n}\n\nfunc termPids() {\n\trunning = false\n\tprocessLock.Lock()\n\tdefer processLock.Unlock()\n\n\tfor _, process := range processes {\n\t\tlog.Infof(\"sending SIGTERM to %d\", process.Pid)\n\t\tprocess.Signal(syscall.SIGTERM)\n\t}\n}\n\nfunc execute(line string, doneChannel chan string) {\n\tdefer func() { doneChannel <- line }()\n\n\tstart := time.Now()\n\tcount := 0\n\n\targs := strings.Split(line, \" \")\n\n\tfor {\n\t\tcmd := exec.Command(args[0], args[1:]...)\n\t\tcmd.Stdout = os.Stdout\n\t\tcmd.Stderr = os.Stderr\n\t\tcmd.SysProcAttr = &syscall.SysProcAttr{\n\t\t\tSetsid: true,\n\t\t}\n\n\t\tif err := cmd.Start(); err == nil {\n\t\t\taddProcess(cmd.Process)\n\t\t\tif err = cmd.Wait(); err != nil {\n\t\t\t\tlog.Errorf(\"Wait cmd to exit: %s, err: %v\", line, err)\n\t\t\t}\n\t\t\tremoveProcess(cmd.Process)\n\t\t} else {\n\t\t\tlog.Errorf(\"Start cmd: %s, err: %v\", line, err)\n\t\t}\n\n\t\tif !running {\n\t\t\tlog.Infof(\"%s : not restarting, exiting\", line)\n\t\t\tbreak\n\t\t}\n\n\t\tcount++\n\n\t\tif count > 10 {\n\t\t\tif time.Now().Sub(start) <= (1 * time.Second) {\n\t\t\t\tlog.Errorf(\"%s : restarted too fast, not executing\", line)\n\t\t\t\tbreak\n\t\t\t}\n\n\t\t\tcount = 0\n\t\t\tstart = time.Now()\n\t\t}\n\t}\n}\n" }, { "path": "cmd/sysinit/sysinit.go", "content": "package sysinit\n\nimport (\n\t\"io/ioutil\"\n\t\"os\"\n\n\t\"github.com/burmilla/os/pkg/log\"\n\t\"github.com/burmilla/os/pkg/sysinit\"\n)\n\nfunc Main() {\n\tlog.InitLogger()\n\n\tresolve, err := ioutil.ReadFile(\"/etc/resolv.conf\")\n\tlog.Infof(\"Resolv.conf == [%s], %v\", resolve, err)\n\tlog.Infof(\"Exec %v\", os.Args)\n\n\tif err := sysinit.SysInit(); err != nil {\n\t\tlog.Fatal(err)\n\t}\n}\n" }, { "path": "cmd/wait/wait.go", "content": "package wait\n\nimport (\n\t\"os\"\n\n\t\"github.com/burmilla/os/config\"\n\t\"github.com/burmilla/os/pkg/docker\"\n\t\"github.com/burmilla/os/pkg/log\"\n)\n\nfunc Main() {\n\tlog.InitLogger()\n\t_, err := docker.NewClient(config.DockerHost)\n\tif err != nil {\n\t\tlog.Errorf(\"Failed to connect to Docker\")\n\t\tos.Exit(1)\n\t}\n\n\tlog.Infof(\"Docker is ready\")\n}\n" }, { "path": "config/cloudinit/.gitignore", "content": "*.swp\nbin/\ncoverage/\ngopath/\n" }, { "path": "config/cloudinit/.travis.yml", "content": "language: go\nmatrix:\n include:\n - go: 1.5\n env: GO15VENDOREXPERIMENT=1\n - go: 1.6\n\nscript:\n - ./test\n" }, { "path": "config/cloudinit/CONTRIBUTING.md", "content": "# How to Contribute\n\nCoreOS projects are [Apache 2.0 licensed](LICENSE) and accept contributions via\nGitHub pull requests. This document outlines some of the conventions on\ndevelopment workflow, commit message formatting, contact points and other\nresources to make it easier to get your contribution accepted.\n\n# Certificate of Origin\n\nBy contributing to this project you agree to the Developer Certificate of\nOrigin (DCO). This document was created by the Linux Kernel community and is a\nsimple statement that you, as a contributor, have the legal right to make the\ncontribution. See the [DCO](DCO) file for details.\n\n# Email and Chat\n\nThe project currently uses the general CoreOS email list and IRC channel:\n- Email: [coreos-dev](https://groups.google.com/forum/#!forum/coreos-dev)\n- IRC: #[coreos](irc://irc.freenode.org:6667/#coreos) IRC channel on freenode.org\n\n## Getting Started\n\n- Fork the repository on GitHub\n- Read the [README](README.md) for build and test instructions\n- Play with the project, submit bugs, submit patches!\n\n## Contribution Flow\n\nThis is a rough outline of what a contributor's workflow looks like:\n\n- Create a topic branch from where you want to base your work (usually master).\n- Make commits of logical units.\n- Make sure your commit messages are in the proper format (see below).\n- Push your changes to a topic branch in your fork of the repository.\n- Make sure the tests pass, and add any new tests as appropriate.\n- Submit a pull request to the original repository.\n\nThanks for your contributions!\n\n### Format of the Commit Message\n\nWe follow a rough convention for commit messages that is designed to answer two\nquestions: what changed and why. The subject line should feature the what and\nthe body of the commit should describe the why.\n\n```\nenvironment: write new keys in consistent order\n\nGo 1.3 randomizes the ordering of keys when iterating over a map.\nSort the keys to make this ordering consistent.\n\nFixes #38\n```\n\nThe format can be described more formally as follows:\n\n```\n: \n\n\n\n