[
{
"path": ".gitattributes",
"content": "*.js linguist-language=Java\n*.css linguist-language=Java\n*.html linguist-language=Java\n"
},
{
"path": ".gitignore",
"content": "## .gitignore for Grails 1.2 and 1.3\n\n# .gitignore for maven \ntarget/\n*.releaseBackup\n\n# web application files\n#/web-app/WEB-INF\n\n# IDE support files\n/.classpath\n/.launch\n/.project\n/.settings\n/*.launch\n/*.tmproj\n/ivy*\n/eclipse\n\n# default HSQL database files for production mode\n/prodDb.*\n\n# general HSQL database files\n*Db.properties\n*Db.script\n\n# logs\n/stacktrace.log\n/test/reports\n/logs\n*.log\n*.log.*\n\n# project release file\n/*.war\n\n# plugin release file\n/*.zip\n/*.zip.sha1\n \n# older plugin install locations\n/plugins\n/web-app/plugins\n/web-app/WEB-INF/classes\n \n# \"temporary\" build files\ntarget/\nout/\nbuild/\n \n# other\n*.iws\n \n#.gitignore for java\n*.class\n \n# Package Files #\n*.jar\n*.war\n*.ear\n \n## .gitignore for eclipse\n \n*.pydevproject\n.project\n.metadata\nbin/**\ntmp/**\ntmp/**/*\n*.tmp\n*.bak\n*.swp\n*~.nib\nlocal.properties\n.classpath\n.settings/\n.loadpath\n \n# External tool builders\n.externalToolBuilders/\n \n# Locally stored \"Eclipse launch configurations\"\n*.launch\n \n# CDT-specific\n.cproject\n \n# PDT-specific\n.buildpath\n \n## .gitignore for intellij\n \n*.iml\n*.ipr\n*.iws\n.idea/\n \n## .gitignore for linux\n.*\n!.gitignore\n!.gitattributes\n!.editorconfig\n!.eslintrc\n!.travis.yml\n*~\n \n## .gitignore for windows\n \n# Windows image file caches\nThumbs.db\nehthumbs.db\n \n# Folder config file\nDesktop.ini\n \n# Recycle Bin used on file shares\n$RECYCLE.BIN/\n \n## .gitignore for mac os x\n \n.DS_Store\n.AppleDouble\n.LSOverride\nIcon\n \n \n# Thumbnails\n._*\n \n# Files that might appear on external disk\n.Spotlight-V100\n.Trashes\n\n## hack for graddle wrapper\n!wrapper/*.jar\n!**/wrapper/*.jar\n"
},
{
"path": "CODE_OF_CONDUCT.md",
"content": "# Contributor Covenant Code of Conduct\n\n## Our Pledge\n\nIn the interest of fostering an open and welcoming environment, we as\ncontributors and maintainers pledge to making participation in our project and\nour community a harassment-free experience for everyone, regardless of age, body\nsize, disability, ethnicity, sex characteristics, gender identity and expression,\nlevel of experience, education, socio-economic status, nationality, personal\nappearance, race, religion, or sexual identity and orientation.\n\n## Our Standards\n\nExamples of behavior that contributes to creating a positive environment\ninclude:\n\n* Using welcoming and inclusive language\n* Being respectful of differing viewpoints and experiences\n* Gracefully accepting constructive criticism\n* Focusing on what is best for the community\n* Showing empathy towards other community members\n\nExamples of unacceptable behavior by participants include:\n\n* The use of sexualized language or imagery and unwelcome sexual attention or\n advances\n* Trolling, insulting/derogatory comments, and personal or political attacks\n* Public or private harassment\n* Publishing others' private information, such as a physical or electronic\n address, without explicit permission\n* Other conduct which could reasonably be considered inappropriate in a\n professional setting\n\n## Our Responsibilities\n\nProject maintainers are responsible for clarifying the standards of acceptable\nbehavior and are expected to take appropriate and fair corrective action in\nresponse to any instances of unacceptable behavior.\n\nProject maintainers have the right and responsibility to remove, edit, or\nreject comments, commits, code, wiki edits, issues, and other contributions\nthat are not aligned to this Code of Conduct, or to ban temporarily or\npermanently any contributor for other behaviors that they deem inappropriate,\nthreatening, offensive, or harmful.\n\n## Scope\n\nThis Code of Conduct applies both within project spaces and in public spaces\nwhen an individual is representing the project or its community. Examples of\nrepresenting a project or community include using an official project e-mail\naddress, posting via an official social media account, or acting as an appointed\nrepresentative at an online or offline event. Representation of a project may be\nfurther defined and clarified by project maintainers.\n\n## Enforcement\n\nInstances of abusive, harassing, or otherwise unacceptable behavior may be\nreported by contacting the project team at 84226733@qq.com. All\ncomplaints will be reviewed and investigated and will result in a response that\nis deemed necessary and appropriate to the circumstances. The project team is\nobligated to maintain confidentiality with regard to the reporter of an incident.\nFurther details of specific enforcement policies may be posted separately.\n\nProject maintainers who do not follow or enforce the Code of Conduct in good\nfaith may face temporary or permanent repercussions as determined by other\nmembers of the project's leadership.\n\n## Attribution\n\nThis Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4,\navailable at https://www.contributor-covenant.org/version/1/4/code-of-conduct.html\n\n[homepage]: https://www.contributor-covenant.org\n\nFor answers to common questions about this code of conduct, see\nhttps://www.contributor-covenant.org/faq\n"
},
{
"path": "LICENSE.txt",
"content": "MIT License\n\nCopyright (c) 2021 Linlin xiao\n\nPermission is hereby granted, free of charge, to any person obtaining a copy\nof this software and associated documentation files (the \"Software\"), to deal\nin the Software without restriction, including without limitation the rights\nto use, copy, modify, merge, publish, distribute, sublicense, and/or sell\ncopies of the Software, and to permit persons to whom the Software is\nfurnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all\ncopies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\nOUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\nSOFTWARE.\n"
},
{
"path": "README.md",
"content": "# spring-cloud-demo\n## 不定期更新与记录在springcloud开发中所遇到的坑以及解决方法\n## 说明：由于版本不兼容，很多核心、重点的技术难题都以单独的项目形式提交，并同时更新到csdn，如有需要请关注：https://blog.csdn.net/xiaoll880214?type=blog\n\n初始化添加\n1. spring-cloud skywalking demo\n2. add mqtt suports\n3. add 微信小程序 suports mqtt\n4. kafka elk支持\n\n\n20180809\n1. 更新 代码结构\n2. 新增git配置中心\n3. 新增kafka elk demo配置以及文档\n4. 文档结构整理\n5. 分离注册中心和配置中心\n7. 添加zipkin服务跟踪\n\n\n20180905\n1. 自定义注解实现aop日志\n2. 自定义注解实现实体类参数校验\n3. 添加mybatis自定生成映射实体类、mapper等\n4. 添加全局异常处理\n5. 添加fegin自定义数据解析\n\n20180907\n1. 添加注解，作为参数校验入口\n\n20180910\n1. 解决服务之间调用fegin+hystrix 熔断异常拦截处理\n\n20180914\n1. 服务调用之间的rest请求，参数为对象时需要添加@RequestBody注解\n``eg:\nsaveRegionCity(@RequestBody RegionCityDto regionCityDto)``\n2. 服务间调用接口的返回值，不能使接口返回，必须要使用实现类返回，fegin客户端获取不到数据返回Null\n`eg:\n public User getUser(@RequestBody UserQuery query); \n User必须为实现类，不能为接口`\n3. 添加fastjson解析，解决部分调用对象内包含对象传值为空问题\n\n20180921\n1. Doc 目录结构调整\n2. 记录[elk+kafka+logback服务之间调用多1分钟时间之坑](https://github.com/Xlinlin/spring-cloud-demo/blob/master/SpringCloud-Demo-Doc/kafka%2Belk/使用logback-kafka导致服务之间调用多1分钟之坑.md)\n\n20180927\n1. [elk+logstash+logback解析嵌套json数据](https://github.com/Xlinlin/spring-cloud-demo/blob/master/SpringCloud-Demo-Doc/kafka%2Belk/ELK%E6%97%A5%E5%BF%97logstash%E8%A7%A3%E6%9E%90JSON%E5%B5%8C%E5%A5%97.md)\n\n20180930\n1. 添加guava+spring-cache本地缓存实现，[参考入口](https://blog.csdn.net/mafei6827/article/details/80868931)\n2. 记录springcloud 1.x版本解决feignclient下requestmapping与springmvc的定义冲突问题，[参考入口](http://blog.didispace.com/spring-cloud-feignclient-problem/?utm_source=tuicool&utm_medium=referral)\n\n20181009\n1. 添加ES实现电商[搜索基础服务](https://github.com/Xlinlin/spring-cloud-demo/tree/master/SpringCloud-SearchService)\n2. 添加Mockito实现api的junit测试\n\n20181012\n1. redisson yml配置加载，支持单机、集群、云托管、sentinel模式\n 8.0.29 \n \n ```\n [参考资料1](http://www.mamicode.com/info-detail-2280850.html);\n \n \n \n \n \n 4.0.0 \n \n org.springframework.boot \n spring-boot-starter-parent \n 2.1.0.RELEASE \n \n\n Springboot-Admin 2.0版本和SpringBoot 1.5.X版本结合使用 \n\n SpringBoot-Admin \n\n \n UTF-8 \n UTF-8 \n 1.8 \n 1.8 \n 1.8 \n 2.1.0 \n \n\n \n \n de.codecentric \n spring-boot-admin-starter-server \n ${spring-boot-admin.version} \n \n \n de.codecentric \n spring-boot-admin-server-ui \n ${spring-boot-admin.version} \n \n\n \n org.jolokia \n jolokia-core \n \n \n org.projectlombok \n lombok \n \n\n \n org.springframework.boot \n spring-boot-starter-web \n \n \n \n org.slf4j \n slf4j-log4j12 \n \n \n \n\n \n \n \n \n \n\n \n \n \n \n \n \n\n\n \n SpringBoot-Admin \n \n \n ${project.build.directory}/classes \n src/main/resources \n true \n \n **/*.xml \n **/*.yml \n **/*.properties \n META-INF/** \n \n \n \n \n \n org.springframework.boot \n spring-boot-maven-plugin \n \n \n \n build-info \n \n \n \n \n \n \n\n "
},
{
"path": "SpringBoot-Admin/readme.md",
"content": "\nSpringboot-Admin 2.0服务端+Springboot-Admin 1.5.6客户端集成使用监控服务\n \n SpringBoot-Custom-Elasticsearch-Starter \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n Custom-Elasticsearch-Starter \n Custom ElasticSearch High Level Rest Client Stater AutoConfigure \n\n \n \n com.xiao.skywalking.demo \n Custom-Elasticsearch-Starter-Autoconfig \n ${project.version} \n \n \n\n "
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Autoconfig/pom.xml",
"content": "\n\n \n SpringBoot-Custom-Elasticsearch-Starter \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n Custom-Elasticsearch-Starter-Autoconfig \n Custom ElasticSearch High Level Rest Client Stater AutoConfigure \n\n \n 6.8.17 \n \n\n \n \n \n org.springframework.boot \n spring-boot-starter \n \n \n org.springframework.boot \n spring-boot-autoconfigure \n \n\n \n \n org.springframework.boot \n spring-boot-configuration-processor \n true \n \n\n \n org.projectlombok \n lombok \n 1.16.18 \n true \n \n\n \n org.elasticsearch \n elasticsearch \n ${elasticsearch.version} \n \n\n \n org.elasticsearch.client \n elasticsearch-rest-client \n ${elasticsearch.version} \n \n\n \n org.elasticsearch.client \n elasticsearch-rest-high-level-client \n ${elasticsearch.version} \n \n\n \n org.apache.commons \n commons-lang3 \n 3.4 \n \n\n \n com.alibaba \n fastjson \n 1.2.83 \n \n \n\n "
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Autoconfig/src/main/java/com/xiao/custom/elasticsearch/start/autoconfig/ElasticsearchAutoConfiguration.java",
"content": "package com.xiao.custom.elasticsearch.start.autoconfig;\n\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.elasticsearch.start.autoconfig.properties.ElasticsearchProperties;\nimport com.xiao.custom.elasticsearch.start.autoconfig.properties.HostInfo;\nimport lombok.extern.slf4j.Slf4j;\nimport org.apache.commons.lang3.StringUtils;\nimport org.apache.http.HttpHost;\nimport org.apache.http.auth.AuthScope;\nimport org.apache.http.auth.UsernamePasswordCredentials;\nimport org.apache.http.client.CredentialsProvider;\nimport org.apache.http.impl.client.BasicCredentialsProvider;\nimport org.elasticsearch.client.RestClient;\nimport org.elasticsearch.client.RestClientBuilder;\nimport org.elasticsearch.client.RestHighLevelClient;\nimport org.springframework.beans.factory.DisposableBean;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnMissingBean;\nimport org.springframework.boot.context.properties.EnableConfigurationProperties;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\nimport org.springframework.util.CollectionUtils;\n\nimport java.util.List;\n\n/**\n * [简要描述]: 自动装配\n * [详细描述]: \n * EnableAutoConfiguration 利用SpringFactoriesLoader机制加载所有的AutoConfiguration类 META-INF/spring.factories\n *\n * @author llxiao\n * @version 1.0, 2019/8/28 10:28\n * @since JDK 1.8\n */\n@Configuration\n@EnableConfigurationProperties(ElasticsearchProperties.class)\n@Slf4j\npublic class ElasticsearchAutoConfiguration implements DisposableBean\n{\n private RestHighLevelClient restHighLevelClient;\n\n @Bean\n @ConditionalOnMissingBean\n public RestHighLevelClient restHighLevelClient(ElasticsearchProperties elasticsearchProperties)\n {\n if (log.isDebugEnabled())\n {\n log.debug(\"初始化Elasticsearch Rest High Level Client....\");\n }\n List hosts = elasticsearchProperties.getHosts();\n if (CollectionUtils.isEmpty(hosts))\n {\n throw new RuntimeException(\"Elasticsearch host配置为空，请检查：spring.elasticsearch.rest.hosts的配置是否正确\");\n }\n\n if (log.isDebugEnabled())\n {\n log.debug(\"Elasticsearch host: {}\", JSONObject.toJSONString(hosts));\n }\n\n HttpHost[] httpHosts = new HttpHost[hosts.size()];\n int i = 0;\n for (HostInfo host : hosts)\n {\n httpHosts[i++] = new HttpHost(host.getHostname(), host.getPort(), host.getSchema());\n }\n\n RestClientBuilder restClientBuilder = RestClient.builder(httpHosts);\n restClientBuilder.setMaxRetryTimeoutMillis(elasticsearchProperties.getMaxRetryTimeout());\n\n // 请求参数设置\n restClientBuilder.setRequestConfigCallback(requestConfigBuilder ->\n {\n requestConfigBuilder.setConnectTimeout(elasticsearchProperties.getConnectTimeout());\n requestConfigBuilder.setSocketTimeout(elasticsearchProperties.getSocketTimeout());\n requestConfigBuilder.setConnectionRequestTimeout(elasticsearchProperties.getRequestTimeout());\n return requestConfigBuilder;\n });\n\n //异步 httpclient 连接参数配置\n restClientBuilder.setHttpClientConfigCallback(httpClientBuilder ->\n {\n httpClientBuilder.setMaxConnTotal(elasticsearchProperties.getMaxConnect());\n httpClientBuilder.setMaxConnPerRoute(elasticsearchProperties.getMaxConnectRoute());\n\n // httpClientBuilder.setThreadFactory();\n // SSL 配置\n // httpClientBuilder.setSSLContext()\n\n // 请求队列头部拦截 ，request response HttpResponseInterceptor HttpRequestInterceptor\n // httpClientBuilder.addInterceptorFirst();\n // 请求队列尾部拦截 ，request response\n // httpClientBuilder.addInterceptorLast();\n\n // 鉴权设置\n if (StringUtils.isNotBlank(elasticsearchProperties.getUsername()) && StringUtils\n .isNotBlank(elasticsearchProperties.getPassword()))\n {\n CredentialsProvider credentialsProvider = new BasicCredentialsProvider();\n credentialsProvider\n .setCredentials(AuthScope.ANY, new UsernamePasswordCredentials(elasticsearchProperties\n .getUsername(), elasticsearchProperties.getPassword()));\n httpClientBuilder.setDefaultCredentialsProvider(credentialsProvider);\n }\n\n return httpClientBuilder;\n });\n\n if (log.isDebugEnabled())\n {\n log.debug(\"初始化Elasticsearch Rest High Level Client 成功!\");\n }\n restHighLevelClient = new RestHighLevelClient(restClientBuilder);\n return restHighLevelClient;\n }\n\n /**\n * Invoked by a BeanFactory on destruction of a singleton.\n *\n * @exception Exception in case of shutdown errors.\n * Exceptions will get logged but not rethrown to allow\n * other beans to release their resources too.\n */\n @Override\n public void destroy() throws Exception\n {\n restHighLevelClient.close();\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Autoconfig/src/main/java/com/xiao/custom/elasticsearch/start/autoconfig/properties/ElasticsearchProperties.java",
"content": "package com.xiao.custom.elasticsearch.start.autoconfig.properties;\n\nimport lombok.Data;\nimport org.elasticsearch.client.RestClientBuilder;\nimport org.springframework.boot.context.properties.ConfigurationProperties;\nimport org.springframework.boot.context.properties.NestedConfigurationProperty;\n\nimport java.util.List;\n\n/**\n * [简要描述]: Elasticsearch 配置类\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/8/28 10:18\n * @since JDK 1.8\n */\n@Data\n@ConfigurationProperties(prefix = ElasticsearchProperties.ELASTIC_SEARCH_PREFIX)\npublic class ElasticsearchProperties\n{\n public static final String ELASTIC_SEARCH_PREFIX = \"spring.elasticsearch.rest\";\n\n /**\n * 集群名称\n */\n private String clusterName;\n\n /**\n * 节点信息\n */\n @NestedConfigurationProperty\n private List hosts;\n\n /**\n * 鉴权使用\n */\n private String username;\n private String password;\n\n /**\n * 高亮前缀\n */\n private String highlightPre = \"\";\n /**\n * 高亮后缀\n */\n private String highlightPost = \"\";\n\n /**\n * 连接超时时间\n */\n private int connectTimeout = RestClientBuilder.DEFAULT_CONNECT_TIMEOUT_MILLIS;\n\n /**\n * socket超时时间\n */\n private int socketTimeout = RestClientBuilder.DEFAULT_SOCKET_TIMEOUT_MILLIS;\n\n /**\n * 请求超时时间\n */\n private int requestTimeout = RestClientBuilder.DEFAULT_CONNECT_TIMEOUT_MILLIS;\n\n /**\n * 最大连接数\n */\n private int maxConnect = RestClientBuilder.DEFAULT_MAX_CONN_TOTAL;\n /**\n * 单主机并发最大数\n */\n private int maxConnectRoute = RestClientBuilder.DEFAULT_MAX_CONN_PER_ROUTE;\n\n /**\n * 重试最大超时时间\n */\n private int maxRetryTimeout = RestClientBuilder.DEFAULT_MAX_RETRY_TIMEOUT_MILLIS;\n\n}\n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Autoconfig/src/main/java/com/xiao/custom/elasticsearch/start/autoconfig/properties/HostInfo.java",
"content": "package com.xiao.custom.elasticsearch.start.autoconfig.properties;\n\nimport lombok.Data;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/8/28 10:22\n * @since JDK 1.8\n */\n@Data\npublic class HostInfo\n{\n private String hostname;\n private int port;\n private String schema;\n}\n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Autoconfig/src/main/resources/META-INF/spring.factories",
"content": "org.springframework.boot.autoconfigure.EnableAutoConfiguration=\\\ncom.xiao.custom.elasticsearch.start.autoconfig.ElasticsearchAutoConfiguration"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/pom.xml",
"content": "\n\n \n SpringBoot-Custom-Elasticsearch-Starter \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n Custom-Elasticsearch-Starter-Example \n Custom ElasticSearch High Level Rest Client Stater Example \n\n \n 6.3.2 \n 2.17.1 \n \n\n \n \n org.springframework.boot \n spring-boot-starter-web \n \n \n \n org.slf4j \n slf4j-log4j12 \n \n \n \n\n \n org.apache.logging.log4j \n log4j-api \n ${log4j2.version} \n \n \n org.apache.logging.log4j \n log4j-core \n ${log4j2.version} \n \n\n \n org.springframework.boot \n spring-boot-starter-test \n test \n \n\n \n com.xiao.skywalking.demo \n Custom-Elasticsearch-Starter \n ${project.version} \n \n\n \n\n \n ${project.artifactId} \n \n \n ${project.build.directory}/classes \n src/main/resources \n true \n \n **/*.xml \n **/*.yml \n **/*.properties \n META-INF/** \n \n \n \n \n \n org.springframework.boot \n spring-boot-maven-plugin \n \n \n \n\n "
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/src/main/java/com/xiao/custom/elasticsearch/starter/example/ElasticsearchApplication.java",
"content": "package com.xiao.custom.elasticsearch.starter.example;\n\nimport org.springframework.boot.SpringApplication;\nimport org.springframework.boot.autoconfigure.SpringBootApplication;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/8/28 13:54\n * @since JDK 1.8\n */\n@SpringBootApplication\npublic class ElasticsearchApplication\n{\n public static void main(String[] args)\n {\n SpringApplication.run(ElasticsearchApplication.class, args);\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/src/main/resources/application.properties",
"content": "#spring.elasticsearch.rest.clusterName=omni-dev-es\n#spring.elasticsearch.rest.hosts[0].hostname=192.168.206.210\n#spring.elasticsearch.rest.hosts[0].port=9200\n#spring.elasticsearch.rest.hosts[0].schema=http\n#spring.elasticsearch.rest.connectTimeout=1000\n#spring.elasticsearch.rest.socketTimeout=30000\n#spring.elasticsearch.rest.requestTimeout=500\n#spring.elasticsearch.rest.maxConnect=30\n#spring.elasticsearch.rest.maxConnectRoute=10\n#spring.elasticsearch.rest.maxRetryTimeout=30000\n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/src/main/resources/application.yml",
"content": "spring:\n elasticsearch:\n rest:\n clusterName: omni-dev-es\n hosts:\n -\n hostname: 192.168.206.210\n port: 9200\n schema: http\n #-\n #hostname: 192.168.206.212\n #port: 9200\n #schema: http\n #username: you username\n #password: you passwd\n # 连接超时时间,单位ms,默认1S\n connectTimeout: 1000\n # socket超时时间,单位ms,默认30S\n socketTimeout: 30000\n # 请求超时时间,单位ms,默认500ms\n requestTimeout: 500\n # 单机最大连接数,默认30个\n maxConnect: 30\n # 单机最大并发数,默认10个\n maxConnectRoute: 10\n # 最大重试时间,默认30S\n maxRetryTimeout: 30000\n # 高亮前缀\n #highlightPre: \n # 高亮后缀\n #highlightPost: \n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/src/main/resources/bootstrap.yml",
"content": ""
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/src/main/resources/logback-spring.xml",
"content": "\n\n\n \n \n \n \n %d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level %logger{50} - %msg%n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n \n \n \n\n \n \n \n\n\n "
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example/src/test/java/com/xiao/custom/elasticsearch/starter/example/ElasticsearchApplicationTest.java",
"content": "package com.xiao.custom.elasticsearch.starter.example;\n\nimport com.alibaba.fastjson.JSONArray;\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.elasticsearch.start.autoconfig.properties.ElasticsearchProperties;\nimport org.apache.commons.lang3.StringUtils;\nimport org.apache.http.Header;\nimport org.apache.http.HttpEntity;\nimport org.apache.http.entity.ContentType;\nimport org.apache.http.message.BasicHeader;\nimport org.apache.http.nio.entity.NStringEntity;\nimport org.apache.http.util.EntityUtils;\nimport org.elasticsearch.ElasticsearchException;\nimport org.elasticsearch.action.DocWriteRequest;\nimport org.elasticsearch.action.DocWriteResponse;\nimport org.elasticsearch.action.admin.indices.alias.Alias;\nimport org.elasticsearch.action.admin.indices.close.CloseIndexRequest;\nimport org.elasticsearch.action.admin.indices.close.CloseIndexResponse;\nimport org.elasticsearch.action.admin.indices.create.CreateIndexRequest;\nimport org.elasticsearch.action.admin.indices.create.CreateIndexResponse;\nimport org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest;\nimport org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse;\nimport org.elasticsearch.action.admin.indices.get.GetIndexRequest;\nimport org.elasticsearch.action.admin.indices.open.OpenIndexRequest;\nimport org.elasticsearch.action.admin.indices.open.OpenIndexResponse;\nimport org.elasticsearch.action.bulk.*;\nimport org.elasticsearch.action.delete.DeleteRequest;\nimport org.elasticsearch.action.delete.DeleteResponse;\nimport org.elasticsearch.action.get.GetRequest;\nimport org.elasticsearch.action.get.GetResponse;\nimport org.elasticsearch.action.index.IndexRequest;\nimport org.elasticsearch.action.index.IndexResponse;\nimport org.elasticsearch.action.search.SearchRequest;\nimport org.elasticsearch.action.search.SearchResponse;\nimport org.elasticsearch.action.support.master.AcknowledgedRequest;\nimport org.elasticsearch.action.support.replication.ReplicationResponse;\nimport org.elasticsearch.action.update.UpdateRequest;\nimport org.elasticsearch.action.update.UpdateResponse;\nimport org.elasticsearch.client.Response;\nimport org.elasticsearch.client.RestClient;\nimport org.elasticsearch.client.RestHighLevelClient;\nimport org.elasticsearch.common.settings.Settings;\nimport org.elasticsearch.common.unit.ByteSizeUnit;\nimport org.elasticsearch.common.unit.ByteSizeValue;\nimport org.elasticsearch.common.unit.TimeValue;\nimport org.elasticsearch.common.xcontent.XContentBuilder;\nimport org.elasticsearch.common.xcontent.XContentFactory;\nimport org.elasticsearch.common.xcontent.XContentType;\nimport org.elasticsearch.index.get.GetResult;\nimport org.elasticsearch.index.query.QueryBuilders;\nimport org.elasticsearch.rest.RestStatus;\nimport org.elasticsearch.search.builder.SearchSourceBuilder;\nimport org.elasticsearch.search.fetch.subphase.FetchSourceContext;\nimport org.elasticsearch.search.fetch.subphase.highlight.HighlightBuilder;\nimport org.junit.Test;\nimport org.junit.runner.RunWith;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.boot.test.context.SpringBootTest;\nimport org.springframework.test.context.junit4.SpringRunner;\n\nimport java.io.IOException;\nimport java.util.*;\nimport java.util.concurrent.TimeUnit;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/8/28 13:56\n * @since JDK 1.8\n */\n@RunWith(SpringRunner.class)\n@SpringBootTest\npublic class ElasticsearchApplicationTest\n{\n @Autowired\n private RestHighLevelClient restHighLevelClient;\n\n @Autowired\n private ElasticsearchProperties elasticsearchProperties;\n\n /**\n * 搜索\n * https://www.elastic.co/guide/en/elasticsearch/client/java-rest/6.2/java-rest-high-search.html\n */\n @Test\n public void testQuery()\n {\n SearchRequest request = new SearchRequest(\"10000\");\n // request.searchType(\"10000\");\n SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();\n searchSourceBuilder.query(QueryBuilders.termQuery(\"commodityNo\", \"3439538790\"));\n\n searchSourceBuilder.from(0);\n searchSourceBuilder.size(10);\n searchSourceBuilder.timeout(new TimeValue(60, TimeUnit.SECONDS));\n\n // 高亮设置\n HighlightBuilder highlightBuilder = new HighlightBuilder().field(\"*\").requireFieldMatch(false);\n if (StringUtils.isNoneEmpty(elasticsearchProperties.getHighlightPre()))\n {\n highlightBuilder.preTags(elasticsearchProperties.getHighlightPre());\n highlightBuilder.postTags(elasticsearchProperties.getHighlightPost());\n highlightBuilder.field(\"subTitle\");\n highlightBuilder.field(\"title\");\n }\n searchSourceBuilder.highlighter(highlightBuilder);\n\n request.source(searchSourceBuilder);\n\n try\n {\n final SearchResponse response = restHighLevelClient.search(request);\n response.getHits().forEach(document -> System.out.println(document.getSourceAsString()));\n }\n catch (IOException e)\n {\n e.printStackTrace();\n }\n }\n\n /**\n * 批处理：\n * 增删改查\n */\n public void testBulkRequest()\n {\n BulkRequest request = new BulkRequest();\n request.add(new DeleteRequest(\"posts\", \"doc\", \"3\"));\n request.add(new UpdateRequest(\"posts\", \"doc\", \"2\").doc(XContentType.JSON, \"other\", \"test\"));\n request.add(new IndexRequest(\"posts\", \"doc\", \"4\").source(XContentType.JSON, \"field\", \"baz\"));\n\n try\n {\n // restHighLevelClient.bulkAsync(request, ActionListener);\n BulkResponse bulkResponse = restHighLevelClient.bulk(request);\n if (bulkResponse.hasFailures())\n {\n for (BulkItemResponse bulkItemResponse : bulkResponse)\n {\n if (bulkItemResponse.isFailed())\n {\n BulkItemResponse.Failure failure = bulkItemResponse.getFailure();\n System.out.println(\"处理失败:\" + failure.getId() + '-' + failure.getMessage());\n }\n }\n }\n\n for (BulkItemResponse bulkItemResponse : bulkResponse)\n {\n DocWriteResponse itemResponse = bulkItemResponse.getResponse();\n\n if (bulkItemResponse.getOpType() == DocWriteRequest.OpType.INDEX\n || bulkItemResponse.getOpType() == DocWriteRequest.OpType.CREATE)\n {\n IndexResponse indexResponse = (IndexResponse) itemResponse;\n // 创建\n\n }\n else if (bulkItemResponse.getOpType() == DocWriteRequest.OpType.UPDATE)\n {\n UpdateResponse updateResponse = (UpdateResponse) itemResponse;\n // 更新\n\n }\n else if (bulkItemResponse.getOpType() == DocWriteRequest.OpType.DELETE)\n {\n DeleteResponse deleteResponse = (DeleteResponse) itemResponse;\n // 删除\n }\n }\n\n }\n catch (IOException e)\n {\n e.printStackTrace();\n }\n }\n\n /**\n * BulkProcessor通过提供一个实用程序类简化了批量API的使用，该实用程序类允许在将索引/更新/删除操作添加到处理器时透明地执行这些操作。\n */\n @Test\n public void testBulkProcessor()\n {\n BulkProcessor.Listener listener = new BulkProcessor.Listener()\n {\n @Override\n public void beforeBulk(long executionId, BulkRequest request)\n {\n int numberOfActions = request.numberOfActions();\n System.out.println(\"当前BulkProcessor中执行的操作数:\" + numberOfActions);\n }\n\n @Override\n public void afterBulk(long executionId, BulkRequest request, BulkResponse response)\n {\n if (response.hasFailures())\n {\n System.out.println(\"当前BulkProcessor执行出现异常：\" + response.buildFailureMessage());\n }\n else\n {\n System.out.println(\"执行成功!\");\n }\n }\n\n @Override\n public void afterBulk(long executionId, BulkRequest request, Throwable failure)\n {\n System.out.println(\"当前请求发生的错误消息：\" + failure.getMessage());\n failure.printStackTrace();\n }\n };\n\n BulkProcessor.Builder builder = BulkProcessor.builder(restHighLevelClient::bulkAsync, listener);\n //根据当前添加的操作数设置刷新新批量请求的时间 defaults to 1000\n builder.setBulkActions(500);\n // 根据当前添加的操作的大小设置刷新新批量请求的时间 defaults to 5Mb\n builder.setBulkSize(new ByteSizeValue(1L, ByteSizeUnit.MB));\n // 设置允许执行的并发请求数 默认0仅允许一个\n builder.setConcurrentRequests(0);\n // 设置刷新间隔，如果间隔通过，则刷新任何挂起的BulkRequest\n builder.setFlushInterval(TimeValue.timeValueSeconds(10L));\n // 回退策略 等待1秒，最多重试3\n builder.setBackoffPolicy(BackoffPolicy.constantBackoff(TimeValue.timeValueSeconds(1L), 3));\n\n BulkProcessor bulkProcessor = builder.build();\n IndexRequest one = new IndexRequest(\"posts\", \"doc\", \"1\").\n source(XContentType.JSON, \"title\", \"In which order are my Elasticsearch queries executed?\");\n IndexRequest two = new IndexRequest(\"posts\", \"doc\", \"2\")\n .source(XContentType.JSON, \"title\", \"Current status and upcoming changes in Elasticsearch\");\n IndexRequest three = new IndexRequest(\"posts\", \"doc\", \"3\")\n .source(XContentType.JSON, \"title\", \"The Future of Federated Search in Elasticsearch\");\n bulkProcessor.add(one);\n bulkProcessor.add(two);\n bulkProcessor.add(three);\n\n try\n {\n // 执行并等待，直到超时\n boolean terminated = bulkProcessor.awaitClose(30L, TimeUnit.SECONDS);\n }\n catch (InterruptedException e)\n {\n e.printStackTrace();\n }\n // 关闭\n bulkProcessor.close();\n }\n\n /**\n * 插入数据 index api\n */\n @Test\n public void testInsert() throws IOException\n {\n String index = \"101010\";\n String type = index;\n String id = UUID.randomUUID().toString();\n IndexRequest indexRequest = new IndexRequest(index, type, id);\n\n // 可以设置版本号，但可能出现版本冲突异常 ElasticsearchException e.status() == RestStatus.CONFLICT\n indexRequest.version(1);\n // or\n // IndexRequest indexRequest = new IndexRequest();\n // indexRequest.index(index);\n // indexRequest.type(type);\n // indexRequest.id(id);\n\n // As json String\n String jsonString = \"{\" + \"\\\"user\\\":\\\"kimchy\\\",\" + \"\\\"postDate\\\":\\\"2013-01-30\\\",\"\n + \"\\\"message\\\":\\\"trying out Elasticsearch\\\"\" + \"}\";\n indexRequest.source(jsonString, XContentType.JSON);\n\n // As map\n Map jsonMap = new HashMap<>();\n jsonMap.put(\"user\", \"kimchy\");\n jsonMap.put(\"postDate\", new Date());\n jsonMap.put(\"message\", \"trying out Elasticsearch\");\n indexRequest.source(jsonMap);\n\n // As XContentBuilder\n\n XContentBuilder builder = XContentFactory.jsonBuilder();\n builder.startObject();\n {\n builder.field(\"user\", \"kimchy\");\n builder.field(\"postDate\", new Date());\n builder.field(\"message\", \"trying out Elasticsearch\");\n }\n builder.endObject();\n indexRequest.source(builder);\n\n // As source\n indexRequest.source(\"user\", \"kimchy\", \"postDate\", new Date(), \"message\", \"trying out Elasticsearch\");\n\n // index or indexAsync\n IndexResponse indexResponse = restHighLevelClient.index(indexRequest);\n\n index = indexResponse.getIndex();\n type = indexResponse.getType();\n id = indexResponse.getId();\n long version = indexResponse.getVersion();\n if (indexResponse.getResult() == DocWriteResponse.Result.CREATED)\n {\n System.out.println(\"ES数据已经成功创建\");\n }\n else if (indexResponse.getResult() == DocWriteResponse.Result.UPDATED)\n {\n System.out.println(\"ES数据已经成功覆盖\");\n }\n ReplicationResponse.ShardInfo shardInfo = indexResponse.getShardInfo();\n if (shardInfo.getTotal() != shardInfo.getSuccessful())\n {\n System.out.println(\"数据创建成功，但成功的shard数量小于总shard数量\");\n }\n if (shardInfo.getFailed() > 0)\n {\n for (ReplicationResponse.ShardInfo.Failure failure : shardInfo.getFailures())\n {\n System.out.println(\"失败原：\" + failure.reason());\n }\n }\n\n }\n\n /**\n * 文档ID 查找\n */\n @Test\n public void testGetIndex()\n {\n GetRequest getRequest = new GetRequest(\"101010\", \"101010\", \"101010\");\n // 设置版本\n // getRequest.version(2);\n\n //禁用获取 _source字段\n getRequest.fetchSourceContext(new FetchSourceContext(false));\n\n try\n {\n // get or getAsync(request,ActionListener)\n GetResponse getResponse = restHighLevelClient.get(getRequest);\n String index = getResponse.getIndex();\n String type = getResponse.getType();\n String id = getResponse.getId();\n if (getResponse.isExists())\n {\n long version = getResponse.getVersion();\n String sourceAsString = getResponse.getSourceAsString();\n Map sourceAsMap = getResponse.getSourceAsMap();\n byte[] sourceAsBytes = getResponse.getSourceAsBytes();\n }\n else\n {\n System.out.println(\"不存在的数据!\");\n }\n }\n catch (ElasticsearchException e)\n {\n if (e.status() == RestStatus.NOT_FOUND)\n {\n System.out.println(\"索引不存在\");\n }\n else if (e.status() == RestStatus.CONFLICT)\n {\n System.out.println(\"版本冲突!\");\n }\n else\n {\n System.out.println(\"其他为未知异常：\" + e.status().name());\n }\n }\n catch (IOException e)\n {\n System.out.println(\"IO 异常\");\n }\n\n }\n\n /**\n * 文档ID 更新\n * 1. 脚本更新\n * 2. 文档更新：部分字段更新和不存在直接插入更新\n */\n @Test\n public void testUpdate() throws IOException\n {\n UpdateRequest request = new UpdateRequest(\"101010\", \"101010\", \"101010\");\n\n // ############## 更新文档数据部分字段使用 .doc ，如果不确定存在则直接插入使用 .upsert方法\n // As JSON String\n String jsonString = \"{\" + \"\\\"updated\\\":\\\"2017-01-01\\\",\" + \"\\\"reason\\\":\\\"daily update\\\"\" + \"}\";\n request.doc(jsonString, XContentType.JSON);\n // request.upsert(jsonString,XContentType.JSON);\n\n // As Map\n Map jsonMap = new HashMap<>();\n jsonMap.put(\"updated\", new Date());\n jsonMap.put(\"reason\", \"daily update\");\n request.doc(jsonMap);\n // request.upsert(jsonMap);\n\n // AS XContentBuilder\n XContentBuilder builder = XContentFactory.jsonBuilder();\n builder.startObject();\n {\n builder.field(\"updated\", new Date());\n builder.field(\"reason\", \"daily update\");\n }\n builder.endObject();\n request.doc(builder);\n request.upsert(builder);\n\n // 设置版本\n // request.version(2);\n\n //指示如果部分文档尚不存在，则必须将其用作upsert文档。\n // request.docAsUpsert(true);\n\n try\n {\n //同步 update 异步 updateAsync(request,ActionListener)\n UpdateResponse updateResponse = restHighLevelClient.update(request);\n String index = updateResponse.getIndex();\n String type = updateResponse.getType();\n String id = updateResponse.getId();\n long version = updateResponse.getVersion();\n if (updateResponse.getResult() == DocWriteResponse.Result.CREATED)\n {\n System.out.println(\"文档不存在，创建成功!\");\n }\n else if (updateResponse.getResult() == DocWriteResponse.Result.UPDATED)\n {\n System.out.println(\"文档更新成功!\");\n }\n else if (updateResponse.getResult() == DocWriteResponse.Result.DELETED)\n {\n System.out.println(\"文档删除成功!\");\n }\n else if (updateResponse.getResult() == DocWriteResponse.Result.NOOP)\n {\n System.out.println(\"没有对文档做任何更新操作!\");\n }\n\n // 获取更新后的数据\n GetResult result = updateResponse.getGetResult();\n if (result.isExists())\n {\n String sourceAsString = result.sourceAsString();\n Map sourceAsMap = result.sourceAsMap();\n byte[] sourceAsBytes = result.source();\n }\n else\n {\n System.out.println(\"文档不存在!\");\n }\n\n // 分片更新失败\n ReplicationResponse.ShardInfo shardInfo = updateResponse.getShardInfo();\n if (shardInfo.getFailed() > 0)\n {\n for (ReplicationResponse.ShardInfo.Failure failure : shardInfo.getFailures())\n {\n System.out.println(\"分片ID:\" + failure.fullShardId() + \"更新失败：\" + failure.reason());\n }\n }\n }\n catch (ElasticsearchException e)\n {\n // 可能有索引没找到，版本异常，参考RestStatus\n System.out.println(\"更新异常：\" + e.status().name());\n }\n }\n\n /**\n * 文档ID 删除\n */\n @Test\n public void testDel()\n {\n DeleteRequest request = new DeleteRequest(\"101010\", \"101010\", \"101010\");\n try\n {\n DeleteResponse deleteResponse = restHighLevelClient.delete(request);\n if (deleteResponse.getResult() == DocWriteResponse.Result.NOT_FOUND)\n {\n System.out.println(\"删除的文档不存在\");\n }\n\n ReplicationResponse.ShardInfo shardInfo = deleteResponse.getShardInfo();\n if (shardInfo.getTotal() != shardInfo.getSuccessful())\n {\n System.out.println(\"删除成功了，但是删除的数量与分片的数量不符合!\");\n }\n if (shardInfo.getFailed() > 0)\n {\n for (ReplicationResponse.ShardInfo.Failure failure : shardInfo.getFailures())\n {\n System.out.println(\"分片ID:\" + failure.fullShardId() + \"更新失败：\" + failure.reason());\n }\n }\n }\n catch (ElasticsearchException e)\n {\n System.out.println(\"删除异常：\" + e.status().name());\n }\n catch (IOException e)\n {\n e.printStackTrace();\n }\n }\n\n /**\n * 创建索引\n *\n * @exception IOException\n */\n @Test\n public void testCreateIndex() throws IOException\n {\n CreateIndexRequest request = new CreateIndexRequest(\"101010\");\n // setting设置\n request.settings(Settings.builder().put(\"index.number_of_shards\", 3).put(\"index.number_of_replicas\", 2));\n // mapping\n // request.mapping();\n request.alias(new Alias(\"101010_alias\"));\n\n // 其他可选参数\n setOptionParams(request);\n\n // 同步创建\n final CreateIndexResponse createIndexResponse = restHighLevelClient.indices().create(request);\n // 所有节点是否已确认请求\n if (createIndexResponse.isAcknowledged())\n {\n System.out.println(\"创建成功!\");\n }\n // 是否在超时前为索引中的每个碎片启动了所需数量的分片副本\n if (createIndexResponse.isShardsAcknowledged())\n {\n System.out.println(\"分片副本都已创建成功\");\n }\n\n // 异步创建\n // restHighLevelClient.indices().createAsync(request, new ActionListener()\n // {\n // @Override\n // public void onResponse(CreateIndexResponse clearIndicesCacheResponse)\n // {\n // System.out.println(\"所有节点是否已确认请求: \" + createIndexResponse.isAcknowledged());\n // System.out.println(\"分片副本都已创建成功:\" + createIndexResponse.isShardsAcknowledged());\n // }\n //\n // @Override\n // public void onFailure(Exception e)\n // {\n // System.out.println(\"请求出现异常，异常信息：\" + e.getMessage());\n // e.printStackTrace();\n // }\n // });\n }\n\n /**\n * 所以是否存在\n */\n @Test\n public void testIndexExist()\n {\n GetIndexRequest request = new GetIndexRequest();\n request.indices(\"10001\");\n try\n {\n System.out.println(restHighLevelClient.indices().exists(request));\n }\n catch (IOException e)\n {\n e.printStackTrace();\n }\n }\n\n /**\n * 删除索引\n */\n @Test\n public void testDelIndex()\n {\n DeleteIndexRequest request = new DeleteIndexRequest(\"101010\");\n // 其他可选参数\n setOptionParams(request);\n\n // 同步\n try\n {\n DeleteIndexResponse response = restHighLevelClient.indices().delete(request);\n System.out.println(\"所有节点已确认：\" + response.isAcknowledged());\n }\n catch (ElasticsearchException exception)\n {\n if (exception.status() == RestStatus.NOT_FOUND)\n {\n System.out.println(\"索引未找到!\");\n }\n }\n catch (IOException e)\n {\n e.printStackTrace();\n }\n\n // 异步\n // restHighLevelClient.indices().deleteAsync(request, new ActionListener()\n // {\n // @Override\n // public void onResponse(DeleteIndexResponse deleteIndexResponse)\n // {\n // System.out.println(\"所有节点已确认：\" + deleteIndexResponse.isAcknowledged());\n // }\n //\n // @Override\n // public void onFailure(Exception e)\n // {\n // if (e instanceof ElasticsearchException)\n // {\n // ElasticsearchException exception = (ElasticsearchException) e;\n // if (exception.status() == RestStatus.NOT_FOUND)\n // {\n // System.out.println(\"索引未找到!\");\n // }\n // }\n // System.out.println(\"删除出现位置异常!\");\n // }\n // });\n }\n\n /**\n * 打开和关闭索引\n */\n @Test\n public void testOpenAndCloseIndex() throws IOException\n {\n OpenIndexRequest openIndexRequest = new OpenIndexRequest(\"index\");\n setOptionParams(openIndexRequest);\n // 同步 open or 异步 openAsync\n OpenIndexResponse openIndexResponse = restHighLevelClient.indices().open(openIndexRequest);\n System.out.println(\"所有节点已确认：\" + openIndexResponse.isAcknowledged());\n System.out.println(\"所有副本分片已确认：\" + openIndexResponse.isShardsAcknowledged());\n\n CloseIndexRequest closeIndexRequest = new CloseIndexRequest(\"index\");\n setOptionParams(closeIndexRequest);\n // 同步 close or 异步 closeAsync\n CloseIndexResponse closeIndexResponse = restHighLevelClient.indices().close(closeIndexRequest);\n System.out.println(\"所有节点已确认：\" + closeIndexResponse.isAcknowledged());\n\n }\n\n private void setOptionParams(AcknowledgedRequest request)\n {\n // 其他可选参数\n request.timeout(TimeValue.timeValueMinutes(2));\n // request.timeout(\"2m\");\n\n // master node\n // request.masterNodeTimeout(TimeValue.timeValueMinutes(1));\n // request.masterNodeTimeout(\"1m\");\n\n // 创建索引API返回响应之前等待的活动分片副本数\n // request.waitForActiveShards(2);\n // request.waitForActiveShards(ActiveShardCount.DEFAULT);\n }\n\n /**\n * [简要描述]:使用LowLevelClient 执行analyzer操作\n * llxiao 2019/9/17 - 10:45\n **/\n @Test\n public void testAnalysis()\n {\n RestClient lowLevelClient = restHighLevelClient.getLowLevelClient();\n JSONObject entity = new JSONObject();\n entity.put(\"analyzer\", \"ik_max_word\");\n entity.put(\"text\", \"我是中国人\");\n HttpEntity httpEntity = new NStringEntity(JSONObject.toJSONString(entity), ContentType.APPLICATION_JSON);\n\n Map params = Collections.emptyMap();\n Header[] defaultHeaders = new Header[] { new BasicHeader(\"header\", \"value\") };\n try\n {\n Response response = lowLevelClient.performRequest(\"POST\", \"_analyze\", params, httpEntity, defaultHeaders);\n JSONObject tokens = JSONObject.parseObject(EntityUtils.toString(response.getEntity()));\n JSONArray arrays = tokens.getJSONArray(\"tokens\");\n String[] result = new String[arrays.size()];\n for (int i = 0; i < arrays.size(); i++)\n {\n JSONObject obj = JSONObject.parseObject(arrays.getString(i));\n result[i] = obj.getString(\"token\");\n }\n System.out.println(Arrays.toString(result));\n }\n catch (IOException e)\n {\n e.printStackTrace();\n }\n }\n\n}\n"
},
{
"path": "SpringBoot-Custom-Elasticsearch-Starter/Readme.md",
"content": "**定制SpringBoot Starter 之Elasticsearch Rest High Level Client Starter**\n\n**1. 自定义SpringBoot Starter 三要素：**\n>1.1.pom :\n```$xslt\n \n org.springframework.boot \n spring-boot-starter \n \n \n org.springframework.boot \n spring-boot-autoconfigure \n \n\n \n \n org.springframework.boot \n spring-boot-configuration-processor \n true \n \n```\n>1.2. 注解使用\n```$xslt\n@Data\n@ConfigurationProperties(prefix = ElasticsearchProperties.ELASTIC_SEARCH_PREFIX)\npublic class ElasticsearchProperties{}\n\n@Configuration\n@EnableConfigurationProperties(ElasticsearchProperties.class)\npublic class ElasticsearchAutoConfiguration{}\n```\n>1.3 EnableAutoConfiguration 利用SpringFactoriesLoader机制加载所有的AutoConfiguration类 META-INF/spring.factories\n```$xslt\norg.springframework.boot.autoconfigure.EnableAutoConfiguration=\\\ncom.xiao.custom.elasticsearch.start.autoconfig.ElasticsearchAutoConfiguration\n```\n\nElasticsearch高级客户端打包集成为Springboot Starter包，详情参考[Example工程](https://github.com/Xlinlin/SpringCloud-Demo/tree/master/SpringBoot-Custom-Elasticsearch-Starter/Custom-Elasticsearch-Starter-Example)\n**2. Custom ElasticSearch High Level Rest Client Starter使用说明：**
\n>2.1Pom引入\n 6.3.2 \n \n\n \n \n com.purcotton.omni \n omni-common-elasticsearch-starter \n ${project.version} \n \n\n \n org.elasticsearch \n elasticsearch \n ${elasticsearch.version} \n \n\n \n org.elasticsearch.client \n elasticsearch-rest-client \n ${elasticsearch.version} \n \n\n \n org.elasticsearch.client \n elasticsearch-rest-high-level-client \n ${elasticsearch.version} \n \n \n```\n>2.2配置文件：\n \n org.springframework.boot \n spring-boot-starter-parent \n 1.5.9.RELEASE \n \n\n 4.0.0 \n\n com.xiao.skywalking.demo \n SpringBoot-Custom-Elasticsearch-Starter \n 0.0.1-SNAPSHOT \n Custom ElasticSearch High Level Rest Client Stater \n pom \n \n Custom-Elasticsearch-Starter-Autoconfig \n Custom-Elasticsearch-Starter \n Custom-Elasticsearch-Starter-Example \n \n\n\n "
},
{
"path": "SpringBoot-Custom-Rest-Starter/Readme.md",
"content": "Springboot Rest Template配置\n\n1. 支持Ok Http和Http连接池模式，内嵌包装成HttClientService服务，并提供完成的请求日志处理\n2. 引入pom:\n ```$xslt\n \n com.xiao.skywalking.demo \n SpringBoot-Custom-Rest-Autconfigure \n 0.0.1-SNAPSHOT \n \n ```\n\n3. Ok Http使用：\n ```$xslt\n rest:\n # okhttp 配置\n okhttp:\n enable: true\n connection-timeout: 12000\n read-timeout: 30000\n write-timeout: 12000\n ```\n \n4. Http pool使用：\n ```$xslt\n rest\n # http pool\n pool:\n enable: true\n max-total: 20\n default-max-per-route: 2\n validate-after-inactivity: 2000\n connect-timeout: 10000\n connection-request-timeout: 10000\n socket-timeout: 10000\n ```\n5. 同步异步使用：\n ```$xslt\n rest:\n http:\n service:\n sync: true\n async: false\n ```\n \n6. 使用方式，推荐使用HttpClientService，因为提供了完整的日志记录：\n ```$xslt\n // 使用包装http client\n @Autowired\n private HttpClientService httpClientService;\n \n // 使用 resttemplate\n @Autowired\n private RestTemplate restTemplate;\n ```\n7. HttpClientService日志处理，实现HttpRequestLogService接口\n ```$xslt\n public class HttpLogServiceImpl implements HttpRequestLogService\n {\n /**\n * [简要描述]:保存日志信息\n \n SpringBoot-Custom-Rest-Starter \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n SpringBoot-Custom-Rest-Autconfigure \n \n \n org.springframework.boot \n spring-boot-starter-web \n \n \n \n org.slf4j \n slf4j-log4j12 \n \n \n \n\n \n org.springframework.retry \n spring-retry \n \n \n org.aspectj \n aspectjweaver \n \n\n \n org.springframework.cloud \n spring-cloud-context \n compile \n 1.3.4.RELEASE \n \n\n \n org.springframework.boot \n spring-boot-starter-aop \n \n\n \n \n org.springframework.boot \n spring-boot-starter \n \n \n org.springframework.boot \n spring-boot-autoconfigure \n \n\n \n \n org.springframework.boot \n spring-boot-configuration-processor \n true \n \n\n \n org.projectlombok \n lombok \n 1.16.18 \n true \n \n\n \n org.apache.commons \n commons-lang3 \n 3.4 \n \n \n commons-collections \n commons-collections \n 3.2.2 \n \n\n \n com.squareup.okhttp3 \n okhttp \n 3.11.0 \n \n\n \n org.apache.httpcomponents \n httpclient \n 4.5.13 \n \n\n \n com.alibaba \n fastjson \n 1.2.83 \n \n\n \n\n "
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/config/RestTemplateConfiguration.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.config;\n\nimport com.xiao.custom.rest.starter.autoconfigure.config.properties.HttpPoolProperties;\nimport com.xiao.custom.rest.starter.autoconfigure.config.properties.OkHttpProperties;\nimport com.xiao.custom.rest.starter.autoconfigure.interceptor.RestInterceptor;\nimport com.xiao.custom.rest.starter.autoconfigure.service.HttpClientService;\nimport com.xiao.custom.rest.starter.autoconfigure.service.impl.HttpClientAsyncServiceImpl;\nimport com.xiao.custom.rest.starter.autoconfigure.service.impl.HttpClientServiceImpl;\nimport com.xiao.custom.rest.starter.autoconfigure.service.impl.HttpRetryService;\nimport lombok.extern.slf4j.Slf4j;\nimport okhttp3.OkHttpClient;\nimport org.apache.http.client.config.RequestConfig;\nimport org.apache.http.config.Registry;\nimport org.apache.http.config.RegistryBuilder;\nimport org.apache.http.conn.socket.ConnectionSocketFactory;\nimport org.apache.http.conn.socket.PlainConnectionSocketFactory;\nimport org.apache.http.conn.ssl.NoopHostnameVerifier;\nimport org.apache.http.conn.ssl.SSLConnectionSocketFactory;\nimport org.apache.http.impl.client.HttpClientBuilder;\nimport org.apache.http.impl.conn.PoolingHttpClientConnectionManager;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnMissingBean;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnProperty;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.ComponentScan;\nimport org.springframework.context.annotation.Configuration;\nimport org.springframework.http.client.ClientHttpRequestFactory;\nimport org.springframework.http.client.HttpComponentsClientHttpRequestFactory;\nimport org.springframework.http.client.OkHttp3ClientHttpRequestFactory;\nimport org.springframework.http.converter.StringHttpMessageConverter;\nimport org.springframework.retry.annotation.EnableRetry;\nimport org.springframework.web.client.DefaultResponseErrorHandler;\nimport org.springframework.web.client.RestTemplate;\n\nimport javax.net.ssl.SSLContext;\nimport javax.net.ssl.SSLSocketFactory;\nimport javax.net.ssl.TrustManager;\nimport javax.net.ssl.X509TrustManager;\nimport java.nio.charset.StandardCharsets;\nimport java.security.KeyManagementException;\nimport java.security.NoSuchAlgorithmException;\nimport java.util.Collections;\n\n/**\n * [简要描述]: 初始化rest template\n * [详细描述]: 开启重试\n *\n * @author llxiao\n * @version 1.0, 2019/11/30 10:43\n * @since JDK 1.8\n */\n@Configuration\n@ComponentScan(\"com.xiao.custom.rest.starter.autoconfigure\")\n@Slf4j\n@EnableRetry\npublic class RestTemplateConfiguration\n{\n\n /**\n * [简要描述]:okHttp支持 registry = RegistryBuilder.create()\n .register(\"http\", PlainConnectionSocketFactory.getSocketFactory()).register(\"https\", socketFactory)\n .build();\n\n PoolingHttpClientConnectionManager connectionManager = new PoolingHttpClientConnectionManager(registry);\n connectionManager.setMaxTotal(httpPoolProperties.getMaxTotal());\n connectionManager.setDefaultMaxPerRoute(httpPoolProperties.getDefaultMaxPerRoute());\n connectionManager.setValidateAfterInactivity(httpPoolProperties.getValidateAfterInactivity());\n RequestConfig requestConfig = RequestConfig.custom()\n //服务器返回数据(response)的时间，超过抛出read timeout\n .setSocketTimeout(httpPoolProperties.getSocketTimeout())\n //连接上服务器(握手成功)的时间，超出抛出connect timeout\n .setConnectTimeout(httpPoolProperties.getConnectTimeout())\n //从连接池中获取连接的超时时间，超时间未拿到可用连接，会抛出org.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for connection from pool\n .setConnectionRequestTimeout(httpPoolProperties.getConnectionRequestTimeout()).build();\n\n return new HttpComponentsClientHttpRequestFactory(HttpClientBuilder.create()\n .setDefaultRequestConfig(requestConfig).setConnectionManager(connectionManager).build());\n }\n\n /**\n * [简要描述]:RestTemplateA typical implementation of this method would follow the following pattern:\n *
\n * Examine the {@linkplain HttpRequest request} and body \n * Optionally {@linkplain HttpRequestWrapper wrap} the request to filter HTTP attributes. \n * Optionally modify the body of the request. \n * Either \n * \n * execute the request using {@link ClientHttpRequestExecution#execute(HttpRequest, byte[])}, \n * or \n * do not execute the request to block the execution altogether. \n * \n * Optionally wrap the response to filter HTTP attributes. \n * \n *\n * @param request the request, containing method, URI, and headers\n * @param body the body of the request\n * @param execution the request execution\n * @return the response\n * @exception IOException in case of I/O errors\n */\n @Override\n public ClientHttpResponse intercept(HttpRequest request, byte[] body, ClientHttpRequestExecution execution)\n throws IOException\n {\n HttpRequestLog requestLog = (HttpRequestLog) ThreadLocalUtil.get(HttpRequestLog.REQUEST_LOG);\n if (null != requestLog)\n {\n requestLog.setMethod(request.getMethod().name());\n requestLog.setHeader(JSONObject.toJSONString(this.filtrationHeaders(request.getHeaders())));\n requestLog.setRequestTime(new Timestamp(System.currentTimeMillis()));\n }\n\n ClientHttpResponse response = execution.execute(request, body);\n\n if (null != requestLog)\n {\n requestLog.setHttpStatus(response.getStatusCode().value());\n requestLog.setResponseTime(new Timestamp(System.currentTimeMillis()));\n }\n return response;\n }\n\n private Map filtrationHeaders(HttpHeaders httpHeaders)\n {\n Map logMap = null;\n if (null != httpHeaders)\n {\n logMap = new HashMap<>();\n Map> headerMap = (Map>) JSONArray.toJSON(httpHeaders);\n for (Map.Entry> stringListEntry : headerMap.entrySet())\n {\n\n if (StringUtils.isNotBlank(stringListEntry.getKey()) && CollectionUtils\n .isNotEmpty(stringListEntry.getValue()))\n {\n logMap.put(stringListEntry.getKey(), stringListEntry.getValue());\n }\n }\n }\n return logMap;\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/log/annotation/RequestLog.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.log.annotation;\n\nimport java.lang.annotation.*;\n\nimport static java.lang.annotation.RetentionPolicy.RUNTIME;\n\n/**\n * [简要描述]: 请HTTP求日志注解\n * [详细描述]:\n * Retention 注解会在class字节码文件中存在，在运行时可以通过反射获取到\n * Inherited 说明子类可以继承父类中的该注解\n * Target 既可以在方法上，也可以在类上\n * Documented说明该注解将被包含在javadoc中\n *\n * @author llxiao\n * @version 1.0, 2019/4/24 11:40\n * @since JDK 1.8\n */\n@Retention(RUNTIME)\n@Inherited\n@Target(ElementType.METHOD)\n@Documented\npublic @interface RequestLog\n{\n String value() default \"\";\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/log/annotation/RequestLogAspect.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.log.annotation;\n\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.rest.starter.autoconfigure.dto.Request;\nimport com.xiao.custom.rest.starter.autoconfigure.log.dto.HttpRequestLog;\nimport com.xiao.custom.rest.starter.autoconfigure.log.service.HttpRequestLogService;\nimport com.xiao.custom.rest.starter.autoconfigure.util.ThreadLocalUtil;\nimport lombok.extern.slf4j.Slf4j;\nimport org.apache.commons.lang3.StringUtils;\nimport org.aspectj.lang.ProceedingJoinPoint;\nimport org.aspectj.lang.annotation.Around;\nimport org.aspectj.lang.annotation.Aspect;\nimport org.aspectj.lang.annotation.Pointcut;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.stereotype.Component;\n\nimport java.sql.Timestamp;\n\n/**\n * [简要描述]: 请求日志切面\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/4/24 11:39\n * @since JDK 1.8\n */\n@Aspect\n@Component\n@Slf4j\npublic class RequestLogAspect\n{\n\n /**\n * 请求响应最大长度\n */\n private static final int MAX_PARAMS_LENGTH = 256;\n\n /**\n * 日志服务\n */\n @Autowired(required = false)\n private HttpRequestLogService httpRequestLogService;\n\n /**\n * [简要描述]:定义一个annotation切入点 T doForObject(Request request);\n\n T doRequest(Request request);\n\n T getForObject(Request request);\n\n /**\n * [简要描述]:formdata 获取请求Response\n * llxiao 2019/8/26 - 16:33\n **/\n ResponseEntity postFormData(Request request);\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/service/impl/HttpClientAsyncServiceImpl.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.service.impl;\n\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.rest.starter.autoconfigure.dto.Request;\nimport com.xiao.custom.rest.starter.autoconfigure.log.annotation.RequestLog;\nimport com.xiao.custom.rest.starter.autoconfigure.service.HttpClientService;\nimport com.xiao.custom.rest.starter.autoconfigure.util.RequestValidatorParamsUtil;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.http.ResponseEntity;\n\nimport java.util.concurrent.CompletableFuture;\nimport java.util.concurrent.ExecutionException;\n\n/**\n * [简要描述]: CompletableFuture实现http异步服务\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/4/24 09:25\n * @since JDK 1.8\n */\n@Slf4j\npublic class HttpClientAsyncServiceImpl implements HttpClientService\n{\n private HttpClientServiceImpl httpClientService;\n\n public HttpClientAsyncServiceImpl(HttpRetryService retryService)\n {\n this.httpClientService = new HttpClientServiceImpl(retryService);\n }\n\n /**\n * [简要描述]: 发起post请求 T doForObject(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n CompletableFuture tCompletableFuture = CompletableFuture\n .supplyAsync(() -> httpClientService.doForObject(request));\n return futureResult(tCompletableFuture, request);\n }\n\n @Override\n @RequestLog\n public T doRequest(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n CompletableFuture tCompletableFuture = CompletableFuture\n .supplyAsync(() -> httpClientService.doRequest(request));\n return futureResult(tCompletableFuture, request);\n }\n\n /**\n * [简要描述]: 不进行encode编码的get请求\n * [详细描述]: 请求参数中的url必须进行手动encode编码\n *\n * @param request : 请求参数\n * @return T\n * mjye 2019/10/23 - 11:32\n **/\n @Override\n @RequestLog\n public T getForObject(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n CompletableFuture future = CompletableFuture.supplyAsync(() -> httpClientService.doForObject(request));\n return futureResult(future, request);\n }\n\n /**\n * [简要描述]:formdata 获取请求Response\n * llxiao 2019/8/26 - 16:33\n **/\n @Override\n @RequestLog\n public ResponseEntity postFormData(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n CompletableFuture> completableFuture = CompletableFuture\n .supplyAsync(() -> httpClientService.postFormData(request));\n return futureResult(completableFuture, request);\n }\n\n private T futureResult(CompletableFuture tCompletableFuture, Request request)\n {\n try\n {\n return tCompletableFuture.get();\n }\n catch (InterruptedException e)\n {\n log.error(\"请求参数：{}\", JSONObject.toJSONString(request));\n log.error(\"Http异步请求线程中断:\", e);\n }\n catch (ExecutionException e)\n {\n log.error(\"请求参数：{}\", JSONObject.toJSONString(request));\n log.error(\"Http异步请求异常:\", e);\n }\n return null;\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/service/impl/HttpClientServiceImpl.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.service.impl;\n\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.rest.starter.autoconfigure.dto.Request;\nimport com.xiao.custom.rest.starter.autoconfigure.log.annotation.RequestLog;\nimport com.xiao.custom.rest.starter.autoconfigure.service.HttpClientService;\nimport com.xiao.custom.rest.starter.autoconfigure.util.RequestValidatorParamsUtil;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.http.HttpEntity;\nimport org.springframework.http.HttpHeaders;\nimport org.springframework.http.MediaType;\nimport org.springframework.http.ResponseEntity;\nimport org.springframework.util.LinkedMultiValueMap;\nimport org.springframework.util.MultiValueMap;\n\nimport java.util.Map;\n\n/**\n * [简要描述]: http同步阻塞服务\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/4/24 09:25\n * @since JDK 1.8\n */\n@Slf4j\npublic class HttpClientServiceImpl implements HttpClientService\n{\n private static final String JSON_UTF_8 = \"application/json; charset=UTF-8\";\n\n private static final String HEADER_ACCEPT = \"Accept\";\n\n /**\n * 带重试机制\n */\n private HttpRetryService retryService;\n\n public HttpClientServiceImpl(HttpRetryService retryService)\n {\n this.retryService = retryService;\n }\n\n /**\n * [简要描述]: 发起post请求 T doForObject(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n T entity = null;\n if (null != request)\n {\n String uri = request.getUri();\n Object params = request.getParams();\n int method = request.getMethod();\n Class responseType = request.getResponseType();\n HttpHeaders headers = request.getHeaders();\n Object uriVariables = request.getUriVariables();\n\n if (Request.POST == method)\n {\n entity = retryService.postForObject(uri, params, responseType, uriVariables);\n }\n else if (Request.JSON == method)\n {\n if (null == headers)\n {\n headers = new HttpHeaders();\n }\n headers.setContentType(MediaType.parseMediaType(JSON_UTF_8));\n headers.add(HEADER_ACCEPT, MediaType.APPLICATION_JSON.toString());\n HttpEntity formEntity = new HttpEntity<>(JSONObject.toJSONString(params), headers);\n entity = retryService.postForObject(uri, formEntity, responseType, uriVariables);\n }\n else\n {\n log.error(\"当期请求暂不支持的操作，请求参数：{}\", JSONObject.toJSONString(request));\n }\n }\n return entity;\n }\n\n /**\n * [简要描述]:普通HTTP请求 T doRequest(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n return retryService.doRequest(request.getUri(), request.getParams(), request.getResponseType());\n }\n\n /**\n * [简要描述]: 不进行encode编码的get请求\n * [详细描述]: 请求参数中的url必须进行手动encode编码\n *\n * @param request : 请求参数\n * @return T\n * mjye 2019/10/23 - 11:32\n **/\n @Override\n @RequestLog\n public T getForObject(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n return retryService.getForObject(request.getUri(), request.getHeaders(), request.getResponseType());\n }\n\n /**\n * [简要描述]:formdata 获取请求Response\n * llxiao 2019/8/26 - 16:33\n **/\n @Override\n @RequestLog\n public ResponseEntity postFormData(Request request)\n {\n if (RequestValidatorParamsUtil.validateParams(request))\n {\n return null;\n }\n HttpEntity httpEntity = null;\n Object params = request.getParams();\n // 请求参数为httpEntity直接发送请求\n if (params instanceof HttpEntity)\n {\n httpEntity = (HttpEntity) params;\n }\n // 需要重新组装 HttpEntity\n else if (params instanceof MultiValueMap)\n {\n MultiValueMap multiValueMap = (MultiValueMap) params;\n httpEntity = new HttpEntity<>(multiValueMap, request.getHeaders());\n }\n else if (params instanceof Map)\n {\n Map parmasMap = (Map) params;\n MultiValueMap multiValueMap = new LinkedMultiValueMap<>();\n for (Map.Entry entry : parmasMap.entrySet())\n {\n multiValueMap.add(entry.getKey(), entry.getValue());\n }\n httpEntity = new HttpEntity<>(multiValueMap, request.getHeaders());\n }\n else\n {\n log.error(\"当亲请求暂不支持的操作请求，请求数据：{}\", JSONObject.toJSONString(request));\n }\n if (null != httpEntity)\n {\n return retryService.postFormData(httpEntity, request.getUri(), request.getResponseType());\n }\n else\n {\n log.error(\"请求异常，无法识别请求数据，请求数据：{}\", JSONObject.toJSONString(request));\n return null;\n }\n\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/service/impl/HttpRetryService.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.service.impl;\n\nimport org.apache.commons.lang3.StringUtils;\nimport org.springframework.http.HttpEntity;\nimport org.springframework.http.HttpHeaders;\nimport org.springframework.http.HttpMethod;\nimport org.springframework.http.ResponseEntity;\nimport org.springframework.retry.annotation.Backoff;\nimport org.springframework.retry.annotation.Retryable;\nimport org.springframework.web.client.RestTemplate;\nimport org.springframework.web.util.UriComponentsBuilder;\n\nimport java.net.SocketTimeoutException;\n\n/**\n * [简要描述]: 重试不能使用接口实现类\n * [详细描述]:\n * 重试机制注解说明（https://blog.csdn.net/u011116672/article/details/77823867）：\n * EnableRetry注解：\n * 能否重试，proxyTargetClass属性为true时（默认false），使用CGLIB代理\n * \n * Retryable注解：注解需要被重试的方法\n * include 指定处理的异常类。默认为空\n * exclude指定不需要处理的异常。默认为空\n * vaue指定要重试的异常。默认为空\n * maxAttempts 最大重试次数。默认3次\n * backoff 重试等待策略。默认使用@Backoff注解\n *
\n * Backoff注解：重试回退策略（立即重试还是等待一会再重试）\n * 不设置参数时，默认使用FixedBackOffPolicy，重试等待1000ms\n * 只设置delay()属性时，使用FixedBackOffPolicy，重试等待指定的毫秒数\n * 当设置delay()和maxDealy()属性时，重试等待在这两个值之间均态分布\n * 使用delay()，maxDealy()和multiplier()属性时，使用ExponentialBackOffPolicy\n * 当设置multiplier()属性不等于0时，同时也设置了random()属性时，使用ExponentialRandomBackOffPolicy\n *
\n * Recover注解: 用于方法。\n * 用于@Retryable失败时的“兜底”处理方法。 @Recover注释的方法必须要与@Retryable注解的方法“签名”保持一致，第一入参为要重试的异常，其他参数与@Retryable保持一致，返回值也要一样，否则无法执行！\n *
\n * CircuitBreaker注解：用于方法，实现熔断模式。\n * include 指定处理的异常类。默认为空\n * exclude指定不需要处理的异常。默认为空\n * vaue指定要重试的异常。默认为空\n * maxAttempts 最大重试次数。默认3次\n * openTimeout 配置熔断器打开的超时时间，默认5s，当超过openTimeout之后熔断器电路变成半打开状态（只要有一次重试成功，则闭合电路）\n * resetTimeout 配置熔断器重新闭合的超时时间，默认20s，超过这个时间断路器关闭\n *\n * @author xiaolinlin\n * @version 1.0, 2020/1/16 17:45\n * @since JDK 1.8\n */\npublic class HttpRetryService\n{\n private RestTemplate restTemplate;\n\n public HttpRetryService(RestTemplate restTemplate)\n {\n this.restTemplate = restTemplate;\n }\n\n /**\n * [简要描述]:发起post请求 T postForObject(String uri, Object params, Class responseType, Object uriVariables)\n {\n if (StringUtils.isNotBlank(uri) && null != params && null != responseType)\n {\n ResponseEntity responseEntity = restTemplate.postForEntity(uri, params, responseType, uriVariables);\n return null == responseEntity ? null : responseEntity.getBody();\n }\n return null;\n }\n\n /**\n * [简要描述]:formdata 获取请求Response\n * xiaolinlin 2020/1/16 - 18:27\n **/\n @Retryable(value = SocketTimeoutException.class, maxAttempts = 3, backoff = @Backoff(delay = 2000, multiplier = 1.5))\n public ResponseEntity postFormData(HttpEntity httpEntity, String uri, Class responseType)\n {\n if (null != httpEntity && StringUtils.isNotBlank(uri) && null != responseType)\n {\n return restTemplate.postForEntity(uri, httpEntity, responseType);\n }\n return null;\n }\n\n /**\n * [简要描述]:不进行encode编码的get请求 T getForObject(String uri, HttpHeaders headers, Class responseType)\n {\n if (StringUtils.isNotBlank(uri) && null != responseType)\n {\n HttpEntity requestEntity = null;\n if (null != headers)\n {\n requestEntity = new HttpEntity<>(null, headers);\n }\n UriComponentsBuilder builder = UriComponentsBuilder.fromHttpUrl(uri);\n ResponseEntity resEntity = restTemplate\n .exchange(builder.build(true).toUri(), HttpMethod.GET, requestEntity, responseType);\n return resEntity.getBody();\n }\n return null;\n\n }\n\n /**\n * [简要描述]:普通post请求 T doRequest(String uri, Object params, Class responseType)\n {\n if (StringUtils.isNotBlank(uri) && null != params && null != responseType)\n {\n return (T) restTemplate.postForObject(uri, params, responseType);\n }\n return null;\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/util/RequestValidatorParamsUtil.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.util;\n\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.rest.starter.autoconfigure.dto.Request;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.util.StringUtils;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author xiaolinlin\n * @version 1.0, 2020/1/16 15:47\n * @since JDK 1.8\n */\n@Slf4j\npublic class RequestValidatorParamsUtil\n{\n public static boolean validateParams(Request request)\n {\n if (null == request || StringUtils.isEmpty(request.getUri()) || null == request.getResponseType())\n {\n log.error(\"请求参数不能为空：{}\", null == request ? \"Request is null!\" : JSONObject.toJSONString(request));\n return true;\n }\n return false;\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/java/com/xiao/custom/rest/starter/autoconfigure/util/ThreadLocalUtil.java",
"content": "package com.xiao.custom.rest.starter.autoconfigure.util;\n\nimport java.util.HashMap;\nimport java.util.Map;\n\n/**\n * [简要描述]: ThreadLocalUtil\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/4/24 09:25\n * @since JDK 1.8\n */\npublic class ThreadLocalUtil\n{\n private static final ThreadLocal> context = ThreadLocal.withInitial(() -> new HashMap<>());\n\n public static Map getThreadLocal()\n {\n return context.get();\n }\n\n /**\n * [简要描述]:从ThreadLocal中获取一个线程变量 map = context.get();\n if (null != map)\n {\n return map.get(key);\n }\n return null;\n }\n\n /**\n * [简要描述]:设置一个键值对到ThreadLocal中 map = context.get();\n if (null == map)\n {\n map = new HashMap<>();\n context.set(map);\n }\n map.put(key, value);\n }\n\n /**\n * [简要描述]:从ThreadLocal的当前线程中删除一个key map = context.get();\n if (null != map)\n {\n map.remove(key);\n }\n }\n\n /**\n * [简要描述]:从ThreadLocal中移除当前线程的变量\n * llxiao 2019/4/24 - 9:41\n **/\n public static void remove()\n {\n context.remove();\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Autconfigure/src/main/resources/META-INF/spring.factories",
"content": "org.springframework.boot.autoconfigure.EnableAutoConfiguration=\\\ncom.xiao.custom.rest.starter.autoconfigure.config.RestTemplateConfiguration"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Example/pom.xml",
"content": "\n\n \n SpringBoot-Custom-Rest-Starter \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n SpringBoot-Custom-Rest-Example \n\n\n \n \n com.xiao.skywalking.demo \n SpringBoot-Custom-Rest-Autconfigure \n ${project.version} \n \n\n \n org.projectlombok \n lombok \n 1.16.18 \n true \n \n\n \n org.springframework.boot \n spring-boot-starter-test \n test \n \n \n\n \n ${project.artifactId} \n \n \n ${project.build.directory}/classes \n src/main/resources \n true \n \n **/*.xml \n **/*.yml \n **/*.properties \n META-INF/** \n \n \n \n \n \n org.springframework.boot \n spring-boot-maven-plugin \n \n \n \n "
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Example/src/main/java/com/xiao/custom/rest/example/RestExampleApp.java",
"content": "package com.xiao.custom.rest.example;\n\nimport org.springframework.boot.SpringApplication;\nimport org.springframework.boot.autoconfigure.SpringBootApplication;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author xiaolinlin\n * @version 1.0, 2020/1/17 20:03\n * @since JDK 1.8\n */\n@SpringBootApplication\npublic class RestExampleApp\n{\n public static void main(String[] args)\n {\n SpringApplication.run(RestExampleApp.class, args);\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Example/src/main/java/com/xiao/custom/rest/example/log/impl/HttpLogServiceImpl.java",
"content": "package com.xiao.custom.rest.example.log.impl;\n\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.custom.rest.starter.autoconfigure.log.dto.HttpRequestLog;\nimport com.xiao.custom.rest.starter.autoconfigure.log.service.HttpRequestLogService;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.stereotype.Service;\n\n/**\n * [简要描述]: HTTP 日志处理实现类\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/11/30 10:26\n * @since JDK 1.8\n */\n@Service\n@Slf4j\npublic class HttpLogServiceImpl implements HttpRequestLogService\n{\n /**\n * [简要描述]:保存日志信息\n\n \n \n \n \n %d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level %logger{50} - %msg%n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n \n \n \n\n \n \n \n\n\n "
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Example/src/test/java/com/xiao/custom/rest/example/RestTemplateStarterAppTest.java",
"content": "package com.xiao.custom.rest.example;\n\nimport org.junit.runner.RunWith;\nimport org.springframework.boot.test.context.SpringBootTest;\nimport org.springframework.test.context.junit4.SpringRunner;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/11/30 10:30\n * @since JDK 1.8\n */\n@RunWith(SpringRunner.class)\n@SpringBootTest\npublic class RestTemplateStarterAppTest\n{\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Example/src/test/java/com/xiao/custom/rest/example/httpclient/HttpClientTest.java",
"content": "package com.xiao.custom.rest.example.httpclient;\n\nimport com.xiao.custom.rest.example.RestTemplateStarterAppTest;\nimport com.xiao.custom.rest.starter.autoconfigure.dto.Request;\nimport com.xiao.custom.rest.starter.autoconfigure.service.HttpClientService;\nimport org.junit.Test;\nimport org.springframework.beans.factory.annotation.Autowired;\n\n/**\n * [简要描述]: HTTP client测试\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/11/30 10:32\n * @since JDK 1.8\n */\npublic class HttpClientTest extends RestTemplateStarterAppTest\n{\n @Autowired\n private HttpClientService httpClientService;\n\n @Test\n public void testHttpGet()\n {\n Request request = new Request();\n request.setResponseType(String.class);\n request.setUri(\"http://www.baidu.com\");\n String forObject = httpClientService.getForObject(request);\n System.out.println(forObject);\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/SpringBoot-Custom-Rest-Example/src/test/java/com/xiao/custom/rest/example/template/RestTemplateTest.java",
"content": "package com.xiao.custom.rest.example.template;\n\nimport com.xiao.custom.rest.example.RestTemplateStarterAppTest;\nimport org.junit.Test;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.web.client.RestTemplate;\n\n/**\n * [简要描述]: resttemplate测试类\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/11/30 10:31\n * @since JDK 1.8\n */\npublic class RestTemplateTest extends RestTemplateStarterAppTest\n{\n @Autowired\n private RestTemplate restTemplate;\n\n @Test\n public void testRest()\n {\n\n }\n}\n"
},
{
"path": "SpringBoot-Custom-Rest-Starter/pom.xml",
"content": "\n\n \n SpringCloud-Demo \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n pom \n \n SpringBoot-Custom-Rest-Autconfigure \n SpringBoot-Custom-Rest-Example \n \n\n SpringBoot-Custom-Rest-Starter \n\n "
},
{
"path": "SpringBoot-Stock-Demo/doc/bootstrap.sh",
"content": "#!/bin/bash\n## 加载配置，避免获取不到java_home \nsource /etc/profile\n\nSERVICE_HOME=/home/admin/services\nSERVICE_NAME=omni-basis-service\n\ncd $SERVICE_HOME/$SERVICE_NAME\nPROG=$SERVICE_HOME/$SERVICE_NAME\nPIDFILE=$SERVICE_HOME/$SERVICE_NAME/$SERVICE_NAME.pid \nJARFILE=$SERVICE_HOME/$SERVICE_NAME/$SERVICE_NAME.jar\n\nSKYWALKING_AGENT=-javaagent:/home/admin/agent/skywalking-agent.jar\nSKYWALKING_SERVCIE_NAME=OMNI-BASIS-SERVICE\n \nstatus() { \n if [ -f $PIDFILE ]; then \n PID=$(cat $PIDFILE) \n if [ ! -x /proc/${PID} ]; then \n return 1 \n else \n return 0 \n fi \n else \n return 1 \n fi \n} \n \ncase \"$1\" in \n start) \n status \n RETVAL=$? \n if [ $RETVAL -eq 0 ]; then \n echo \"-----$PIDFILE exists, process is already running or crashed\" \n exit 1 \n fi \n \n ##检测 java环境\n if [ ! -n $JAVA_HOME ]; then\n echo \"-----Please check JAVA_HOME!\"\n echo \"-----Exist\"\n exist 1\n else\n echo \"-----Jave home: $JAVA_HOME\"\n echo \"-----Starting $PROG ...\" \n #nohup java -server -Xms512m -Xmx512m -jar $JARFILE > $SERVICE_NAME.log 2>&1 &\n nohup java -server -Xms512m -Xmx512m $SKYWALKING_AGENT -Dskywalking.agent.service_name=$SKYWALKING_SERVCIE_NAME -jar $JARFILE > $SERVICE_NAME.log 2>&1 &\n\n RETVAL=$?\n if [ $RETVAL -eq 0 ]; then\n echo \"-----$PROG is started\"\n echo $! > $PIDFILE\n exit 0\n else\n echo \"-----Stopping $PROG\"\n rm -f $PIDFILE\n exit 1\n fi \n fi\n ;; \n stop) \n status \n RETVAL=$? \n if [ $RETVAL -eq 0 ]; then \n echo \"-----Shutting down $PROG\" \n kill -15 `cat $PIDFILE` \n RETVAL=$? \n if [ $RETVAL -eq 0 ]; then \n rm -f $PIDFILE \n else \n echo \"-----Failed to stopping $PROG\" \n fi \n fi \n ;; \n status) \n status \n RETVAL=$? \n if [ $RETVAL -eq 0 ]; then \n PID=$(cat $PIDFILE) \n echo \"-----$PROG is running ($PID)\" \n else \n echo \"-----$PROG is not running\" \n fi \n ;; \n restart) \n $0 stop \n $0 start \n ;; \n *) \n echo \"Usage: $0 {start|stop|restart|status}\" \n ;; \nesac \n"
},
{
"path": "SpringBoot-Stock-Demo/doc/stock.sql",
"content": "CREATE TABLE `t_stock_demo`(\n `id` bigint(64) NOT NULL AUTO_INCREMENT,\n `product_no` varchar(64) NULL,\n `shop_code` varchar(255) NULL,\n `pre_stock` int(3) DEFAULT 0,\n `ava_stock` int(3) DEFAULT 0,\n `total_stock` int(3) DEFAULT 0 ,\n `update_time` timestamp(0) NULL,\n PRIMARY KEY (`id`)\n) ENGINE = InnoDB DEFAULT CHARSET=utf8mb4;\n\nCREATE TABLE `t_order_demo`(\n `id` bigint(64) NOT NULL AUTO_INCREMENT,\n `order_no` varchar(64) NULL,\n `shop_code` varchar(255) NULL,\n `product_no` varchar(64) DEFAULT 0,\n `product_num` int(3) DEFAULT 0 ,\n `status` int(3) NULL,\n `update_time` timestamp(0) NULL,\n PRIMARY KEY (`id`)\n) ENGINE = InnoDB DEFAULT CHARSET=utf8mb4;\n\nCREATE TABLE `t_stock_change_log_demo`(\n `id` bigint(64) NOT NULL AUTO_INCREMENT,\n `product_no` varchar(64) NULL,\n `shop_code` varchar(255) NULL,\n\t`order_no` varchar(255) NULL,\n\t`opt_type` varchar(255) NULL,\n `pre_stock_after` int(3) DEFAULT 0,\n `ava_stock_after` int(3) DEFAULT 0,\n `total_stock_after` int(3) DEFAULT 0 ,\n\t`pre_stock_before` int(3) DEFAULT 0,\n `ava_stock_before` int(3) DEFAULT 0,\n `total_stock_before` int(3) DEFAULT 0 ,\n `update_time` timestamp(0) NULL,\n PRIMARY KEY (`id`)\n) ENGINE = InnoDB DEFAULT CHARSET=utf8mb4;\n"
},
{
"path": "SpringBoot-Stock-Demo/doc/stock_demo_jmeter.jmx",
"content": "\n\n \n \n false \n true \n false \n \n \n \n \n \n \n continue \n \n false \n 10 \n \n 5 \n 1 \n false \n JDBC操作、ifelse、随机数、用户参数、控制器、定时器、循环、计数器、变量、函数等等Jmeter并发操作库存实操，下单、取消单、出库、添加库存等操作并发执行，分布式并发执行。\n问题：jmeter并发执行操作订单(取消、出库)时，订单加redisson分布式锁解决订单重复操作问题\n \n \n \n \n \n \n \n 172.16.80.194 \n 7878 \n 6 \n \n \n \n \n \n 192.168.206.240 \n 7878 \n 6 \n \n \n true \n select 1 \n 5000 \n stockDemo \n jdbc:mysql://192.168.206.201:3306/basisdb?useSSL=false&allowMultiQueries=true \n com.mysql.jdbc.Driver \n true \n Basisuser123 \n 20 \n 10000 \n DEFAULT \n 60000 \n basisuser \n \n \n \n shopCode \n \n \n \n 1000 \n \n \n false \n \n \n \n \n \n productNo \n \n \n \n A001001001 \n \n \n A001001002 \n \n \n A001001003 \n \n \n A001001004 \n \n \n A001001005 \n \n \n A001001006 \n \n \n true \n \n \n \n productNo \n \n \n \n A001001001 \n \n \n false \n \n \n \n \n stockDemo \n Select Statement \n select ava_stock from `t_stock_demo` where shop_code = '${shopCode}' and product_no = '${productNo}'; \n avaStock \n Store as String \n \n \n ${__jexl3(${avaStock_1}>0 ,)} \n false \n true \n \n \n \n \n num \n \n \n \n 3 \n \n \n 2 \n \n \n 4 \n \n \n 1 \n \n \n true \n \n \n \n \n \n false \n ${productNo} \n = \n true \n productNo \n \n \n false \n ${shopCode} \n = \n true \n shopCode \n \n \n false \n ${num} \n = \n true \n num \n \n \n \n /stock/preStock \n POST \n true \n false \n true \n false \n \n \n \n java 操作response as string。\nprev api : https://jmeter.apache.org/api/org/apache/jmeter/samplers/SampleResult.html\nbeanshell docs: https://jmeter.apache.org/usermanual/component_reference.html#BeanShell_Assertion \n String result = prev.getResponseDataAsString();\n\nif("0".equals(result)){\n Failure = true;\n} \nelse \n{\n Failure = false;\t\n}\n \n false \n \n \n \n \n \n \n \n \n num \n \n \n \n 3 \n \n \n 2 \n \n \n 4 \n \n \n 1 \n \n \n true \n \n \n \n \n \n false \n ${productNo} \n = \n true \n productNo \n \n \n false \n ${shopCode} \n = \n true \n shopCode \n \n \n false \n ${num} \n = \n true \n num \n \n \n \n /stock/preStock \n POST \n true \n false \n true \n false \n \n \n \n java 操作response as string。\nprev api : https://jmeter.apache.org/api/org/apache/jmeter/samplers/SampleResult.html\nbeanshell docs: https://jmeter.apache.org/usermanual/component_reference.html#BeanShell_Assertion \n String result = prev.getResponseDataAsString();\n\nif("0".equals(result)){\n Failure = true;\n FailureMessage = "下单失败，库存不足!";\n} \nelse \n{\n Failure = false;\t\n}\n \n false \n \n \n \n \n \n \n \n stockDemo \n Select Statement \n SELECT count(order_no) FROM `t_order_demo` where status = 1; \n count \n Store as String \n \n \n tools 工具选项使用 jex13 表达式 \n ${__jexl3(${count_1}>0 ,)} \n false \n true \n \n \n \n stockDemo \n SELECT order_no FROM `t_order_demo` where status = 1;\n \n Select Statement \n Store as String \n orderNo \n \n \n true \n 获取 sql count返回的结果 \n ${count_1} \n \n \n \n 1 \n 1 \n index \n 0 \n true \n 从1开始，递增1 \n true \n \n \n \n \n \n false \n ${__V(orderNo_${index})} \n = \n true \n orderNo \n \n \n \n /stock/releaseStock \n POST \n true \n false \n true \n false \n \n \n \n ${__jexl3(${count_1}>1 ,)} \n false \n true \n \n \n \n \n \n \n false \n ${__V(orderNo_${__Random(1,${count_1})})} \n = \n true \n orderNo \n \n \n \n /stock/releaseStock \n POST \n true \n false \n true \n false \n \n \n \n ${__jexl3(${count_1}==1 ,)} \n false \n true \n \n \n \n \n \n \n false \n ${__V(orderNo_1)} \n = \n true \n orderNo \n \n \n \n /stock/releaseStock \n POST \n true \n false \n true \n false \n \n \n \n \n \n \n \n stockDemo \n Select Statement \n SELECT count(order_no) FROM `t_order_demo` where status = 1; \n count \n Store as String \n \n \n ${__jexl3(${count_1}>0 ,)} \n false \n true \n \n \n \n stockDemo \n SELECT order_no FROM `t_order_demo` where status = 1;\n \n Select Statement \n Store as String \n orderNo \n \n \n true \n 获取 sql count返回的结果 \n ${count_1} \n \n \n \n 1 \n 1 \n index \n 0 \n true \n 从1开始，递增1 \n true \n \n \n \n \n \n false \n ${__V(orderNo_${index})} \n = \n true \n orderNo \n \n \n \n /stock/releaseStock \n POST \n true \n false \n true \n false \n \n \n \n ${__jexl3(${count_1}>1 ,)} \n false \n true \n \n \n \n \n \n \n false \n ${__V(orderNo_${__Random(1,${count_1})})} \n = \n true \n orderNo \n \n \n \n /stock/warehouse \n POST \n true \n false \n true \n false \n \n \n \n ${__jexl3(${count_1}==1 ,)} \n false \n true \n \n \n \n \n \n \n false \n ${__V(orderNo_1)} \n = \n true \n orderNo \n \n \n \n /stock/warehouse \n POST \n true \n false \n true \n false \n \n \n \n \n \n 定时任务，每10分钟执行一次加库存操作 \n \n \n \n \n productNo \n \n \n \n A001001001 \n \n \n A001001002 \n \n \n A001001003 \n \n \n A001001004 \n \n \n A001001005 \n \n \n A001001006 \n \n \n true \n \n \n \n productNo \n \n \n \n A001001001 \n \n \n false \n \n \n \n num \n \n \n \n 1 \n \n \n 2 \n \n \n 3 \n \n \n true \n \n \n \n \n \n false \n ${shopCode} \n = \n true \n shopCode \n \n \n false \n ${num} \n = \n true \n num \n \n \n false \n ${productNo} \n = \n true \n productNo \n \n \n \n /stock/addStock \n POST \n true \n false \n true \n false \n \n \n \n 30000 \n \n \n \n \n false \n \n saveConfig \n \n true \n true \n true \n true \n true \n true\n true \n true \n true \n false \n true \n true \n false \n false \n false \n true \n false \n false \n false \n true \n 0 \n true \n true \n true \n true \n true \n true \n \n \n \n \n false \n \n saveConfig \n \n true \n true \n true \n true \n true \n true\n true \n true \n true \n false \n true \n true \n false \n false \n false \n true \n false \n false \n false \n true \n 0 \n true \n true \n true \n true \n true \n true \n \n \n \n \n \n \n \n"
},
{
"path": "SpringBoot-Stock-Demo/pom.xml",
"content": "\n\n 4.0.0 \n\n com.purcotton.stock.demo \n stock-demo \n 1.0-SNAPSHOT \n\n \n org.springframework.boot \n spring-boot-starter-parent \n 1.5.9.RELEASE \n \n\n \n UTF-8 \n UTF-8 \n 1.8 \n Dalston.RC1 \n 5.1.2 \n 2.04 \n 3.11.4 \n 4.6.8 \n \n\n \n \n org.springframework.boot \n spring-boot-starter-web \n \n \n \n org.slf4j \n slf4j-log4j12 \n \n \n \n \n org.springframework.boot \n spring-boot-starter-aop \n \n\n \n mysql \n mysql-connector-java \n runtime \n \n \n com.zaxxer \n HikariCP \n 3.3.1 \n \n\n \n org.mybatis.spring.boot \n mybatis-spring-boot-starter \n 1.3.1 \n \n \n com.github.pagehelper \n pagehelper-spring-boot-starter \n 1.2.5 \n \n \n com.github.pagehelper \n pagehelper \n 5.1.4 \n \n\n \n org.projectlombok \n lombok \n 1.18.4 \n provided \n \n\n \n com.alibaba \n fastjson \n 1.2.83 \n \n \n org.apache.commons \n commons-collections4 \n 4.1 \n \n \n org.apache.commons \n commons-lang3 \n 3.6 \n \n\n \n \n org.redisson \n redisson \n ${redission.version} \n \n\n \n \n cn.hutool \n hutool-core \n ${hutool.version} \n \n \n cn.hutool \n hutool-captcha \n ${hutool.version} \n \n \n\n \n \n \n org.springframework.cloud \n spring-cloud-dependencies \n ${spring-cloud.version} \n pom \n import \n \n \n \n\n \n stock-demo \n \n \n ${project.build.directory}/classes \n src/main/resources \n true \n \n **/*.xml \n **/*.yml \n **/*.properties \n META-INF/** \n \n \n \n \n \n org.springframework.boot \n spring-boot-maven-plugin \n \n \n \n\n "
},
{
"path": "SpringBoot-Stock-Demo/readme.md",
"content": "**Jmeter+Springboot+Redisson分布式锁并发订单操作(下单、取消单、完成单、加库存)** res = fairLock.tryLockAsync(50, 10, TimeUnit.SECONDS);`` res = fairLock.tryLockAsync(50, 10, TimeUnit.SECONDS);\n\n try\n {\n //final boolean lock = fairLock.tryLock(50, 10, TimeUnit.SECONDS);\n if (res.get())\n {\n //System.out.println(Thread.currentThread().getName() + \"Redis获得锁。。。\" + System.currentTimeMillis());\n // 校验\n StockDemo stock = stockDemoMapper\n .queryByProduct(stockDemo.getProductNo(), stockDemo.getShopCode(), secureRandom.nextInt(9999));\n if (null == stock)\n {\n // 如果不存在直接抛异常扣库存失败\n log.error(\"商品不存在库存信息：{}\", stockDemo);\n return 0;\n }\n // 需要再次从新获取，库存数据\n StockDemo tempStock = null;\n boolean preStatus = false;\n // 重试次数，5次更新机会\n int tryPreTimes = 0;\n while (null != stock)\n {\n //System.out.println(Thread.currentThread().getName() + \"查询的===========：\" + stock);\n int avaStock = stock.getAvaStock();\n int productNum = stockDemo.getProductNum();\n if (productNum > avaStock)\n {\n // 预占库存不足，抛异常，下单失败\n log.error(\"下单失败，可用库存不足，单号：{}，店铺：{}\", stockDemo.getOrderNo(), shopCode);\n log.error(\"商品：{}，预占库存：{}，实际可用库存：{}\", productNo, productNum, avaStock);\n throw new Exception(\"下单失败，库存不足!\");\n }\n int preStock = stock.getPreStock();\n\n // 预占+ 可用-\n int newAvaStock = avaStock - productNum;\n int newPreStock = preStock + productNum;\n tempStock = new StockDemo();\n tempStock.setId(stock.getId());\n // 旧库存 预占和可用库存\n tempStock.setAvaStock(stock.getAvaStock());\n tempStock.setPreStock(stock.getPreStock());\n // 新库存 预占和可用库存\n tempStock.setNewAvaStock(newAvaStock);\n tempStock.setNewPreStock(newPreStock);\n\n tempStock.setTotalStock(stock.getTotalStock());\n //System.out.println(Thread.currentThread().getName() + \"更新的===========：\" + tempStock);\n\n //尝试CAS，先比较旧值，再更新\n if (optStock(tempStock) > 0)\n {\n // 库存扣减成功\n log.info(\"下单成功，订单号：{}，预占库存数量：{}\", stockDemo.getOrderNo(), productNum);\n addOrder(stockDemo);\n preStatus = true;\n break;\n }\n else\n {\n // 库存扣减与预期的值不对，更新失败，尝试重新更新\n log.info(\"库存扣减与预期的值不对，更新失败，尝试重新更新！\");\n // tryPreTimes++;\n stock = stockDemoMapper.queryByProduct(productNo, shopCode, secureRandom.nextInt(9999));\n }\n }\n\n // 总库存\n tempStock.setTotalStock(stock.getTotalStock());\n tempStock.setNewTotalStock(stock.getTotalStock());\n\n // 预占成功处理日志\n return saveChangeLog(stockDemo, productNo, shopCode, stock, tempStock, preStatus, StockOptTypeEnum.LOCK_STOCK);\n }\n else\n {\n // 此处需要考虑下单失败后，补偿下单扣库存的\n log.error(\"下单失败，获取不到锁!\");\n throw new Exception(\"下单失败，获取不到锁\");\n }\n }\n catch (Exception e)\n {\n log.error(\"库存占用失败!\");\n }\n finally\n {\n //System.out.println(Thread.currentThread().getName() + \"Redis释放锁。。。\" + System.currentTimeMillis());\n fairLock.unlock();\n }\n return 0;\n }\n\n // 下单\n @Transactional(rollbackFor = Exception.class)\n public void addOrder(StockDemo stockDemo)\n {\n OrderDemo orderDemo = new OrderDemo();\n orderDemo.setOrderNo(stockDemo.getOrderNo());\n orderDemo.setProductNo(stockDemo.getProductNo());\n orderDemo.setStatus(1);\n orderDemo.setProductNum(stockDemo.getProductNum());\n orderDemo.setShopCode(stockDemo.getShopCode());\n orderDemoMapper.insert(orderDemo);\n }\n\n // 更新订单状态\n @Transactional(rollbackFor = Exception.class)\n public int updateOrderStatus(String orderNo, int status)\n {\n return orderDemoMapper.updateByOrderNo(orderNo, status);\n }\n\n /**\n * 释放库存\n *\n * @param stockDemo\n * @return\n */\n @Override\n public long releaseStock(StockDemo stockDemo)\n {\n if (checkStock(stockDemo, StockOptTypeEnum.RELEASE_STOCK.getOptType()))\n {\n return 0;\n }\n String productNo = stockDemo.getProductNo();\n String shopCode = stockDemo.getShopCode();\n SecureRandom secureRandom = null;\n try\n {\n secureRandom = SecureRandom.getInstance(\"SHA1PRNG\");\n }\n catch (NoSuchAlgorithmException e)\n {\n e.printStackTrace();\n }\n\n // 公平锁\n final RLock fairLock = redissonClient.getFairLock(StockUtil.getLockPath(productNo, shopCode));\n // 异步 尝试加锁，最多等待50秒，上锁以后10秒自动解锁\n Future res = fairLock.tryLockAsync(50, 10, TimeUnit.SECONDS);\n try\n {\n //final boolean lock = fairLock.tryLock(50, 10, TimeUnit.SECONDS);\n if (res.get())\n {\n //System.out.println(Thread.currentThread().getName() + \"Redis获得锁。。。\" + System.currentTimeMillis());\n // 校验\n StockDemo stock = stockDemoMapper\n .queryByProduct(stockDemo.getProductNo(), stockDemo.getShopCode(), secureRandom.nextInt(9999));\n if (null == stock)\n {\n // 如果不存在直接抛异常扣库存失败\n log.error(\"商品不存在库存信息：{}\", stockDemo);\n return 0;\n }\n StockDemo tempStock = null;\n boolean release = false;\n // 重试次数，5次更新机会\n while (null != stock)\n {\n //System.out.println(Thread.currentThread().getName() + \"查询的===========：\" + stock);\n int avaStock = stock.getAvaStock();\n int preStock = stock.getPreStock();\n int productNum = stockDemo.getProductNum();\n\n // 可用+ 预占-\n int newAvaStock = avaStock + productNum;\n int newPreStock = preStock - productNum;\n\n // 释放的库存必须是原有订单的库存数，也就是释放的库存不能为负数，否则就会出现数据异常\n if (productNum > preStock)\n {\n log.error(\"释放库存异常，释放库存已经大与现有的预占库存，释放库存数据本身有问题\");\n throw new Exception(\"释放库存已经大与现有的预占库存!\");\n }\n\n int totalStock = stock.getTotalStock();\n\n // 预占+可用应该永远是=总库存的。即使总库存真实的减了，预占库存应该会对应的减\n if (newAvaStock + newPreStock != totalStock)\n {\n //\n log.error(\"库存释放异常，可用库存+预占库存与总库存数量不符合!总库存：{}，预占库存：{}，可用库存：{}\", totalStock, newPreStock, newAvaStock);\n throw new Exception(\"库存扣释放异常，可用库存+预占库存与总库存数量不符合\");\n }\n\n tempStock = new StockDemo();\n tempStock.setId(stock.getId());\n // 旧库存 可用库存和预占库存\n tempStock.setAvaStock(stock.getAvaStock());\n tempStock.setPreStock(stock.getPreStock());\n // 新库存 可用库存和预占库存\n tempStock.setNewAvaStock(newAvaStock);\n tempStock.setNewPreStock(newPreStock);\n\n //System.out.println(Thread.currentThread().getName() + \"更新的===========：\" + tempStock);\n //尝试CAS，先比较旧值，再更新\n if (optStock(tempStock) > 0)\n {\n // 库存释放成功\n log.info(\"库存释放成功，订单号：{},释放数量：{}\", stockDemo.getOrderNo(), productNum);\n release = true;\n // 订单已完成\n this.updateOrderStatus(stockDemo.getOrderNo(), 0);\n break;\n }\n else\n {\n // 库存释放与预期的值不对，更新失败，尝试重新更新\n log.info(\"库存释放更新时与预期的值不对，更新失败，尝试重新更新！\");\n // tryPreTimes++;\n stock = stockDemoMapper.queryByProduct(productNo, shopCode, secureRandom.nextInt(9999));\n }\n }\n // 总库存\n tempStock.setTotalStock(stock.getTotalStock());\n tempStock.setNewTotalStock(stock.getTotalStock());\n\n // 预占成功处理日志\n return saveChangeLog(stockDemo, productNo, shopCode, stock, tempStock, release, StockOptTypeEnum.RELEASE_STOCK);\n }\n else\n {\n // 此处需要考虑下单失败后，补偿下单扣库存的\n log.error(\"库存释放失败，获取不到锁!\");\n throw new Exception(\"库存释放失败，获取不到锁\");\n }\n }\n catch (Exception e)\n {\n log.error(\"库存释放失败!\");\n }\n finally\n {\n //System.out.println(Thread.currentThread().getName() + \"释放锁。。。\" + System.currentTimeMillis());\n fairLock.unlock();\n }\n return 0;\n }\n\n /**\n * 出库\n *\n * @param stockDemo\n * @return\n */\n @Override\n public long outHourse(StockDemo stockDemo)\n {\n if (checkStock(stockDemo, StockOptTypeEnum.OUT_WAREHOUSE_STOCK.getOptType()))\n {\n return 0;\n }\n String productNo = stockDemo.getProductNo();\n String shopCode = stockDemo.getShopCode();\n\n SecureRandom secureRandom = null;\n try\n {\n secureRandom = SecureRandom.getInstance(\"SHA1PRNG\");\n }\n catch (NoSuchAlgorithmException e)\n {\n e.printStackTrace();\n }\n // 公平锁\n final RLock fairLock = redissonClient.getFairLock(StockUtil.getLockPath(productNo, shopCode));\n // 异步 尝试加锁，最多等待50秒，上锁以后10秒自动解锁\n Future res = fairLock.tryLockAsync(50, 10, TimeUnit.SECONDS);\n try\n {\n // final boolean lock = fairLock.tryLock(50, 10, TimeUnit.SECONDS);\n if (res.get())\n {\n // 校验\n StockDemo stock = stockDemoMapper\n .queryByProduct(stockDemo.getProductNo(), stockDemo.getShopCode(), secureRandom.nextInt(999));\n if (null == stock)\n {\n // 如果不存在直接抛异常扣库存失败\n log.error(\"商品不存在库存信息：{}\", stockDemo);\n return 0;\n }\n StockDemo tempStock = null;\n boolean outHourse = false;\n // 重试次数，5次更新机会\n int tryPreTimes = 0;\n //&& tryPreTimes < 5\n while (null != stock)\n {\n // System.out.println(\"查询的===========：\" + stock);\n int preStock = stock.getPreStock();\n int totalStock = stock.getTotalStock();\n int productNum = stockDemo.getProductNum();\n\n // 出库查库存应该是原来总库存中的数据，不能出现扣库存超数量情况\n if (productNum > preStock || productNum > totalStock)\n {\n log.error(\"扣减实际库存异常，释放库存已经大与现有的预占库存或大与现有的总库存，扣减库存数据本身有问题\");\n throw new Exception(\"扣减实际库存大与现有的预占和总库存!\");\n }\n\n //预占-，总库存-\n int newPreStock = preStock - productNum;\n int newTotalStock = totalStock - productNum;\n\n int avaStock = stock.getAvaStock();\n // 预占+可用应该永远是=总库存的。即使总库存真实的减了，预占库存应该会对应的减\n if (avaStock + newPreStock != newTotalStock)\n {\n //\n log.error(\"库存扣减异常，可用库存+预占库存与总库存数量不符合!总库存：{}，预占库存：{}，可用库存：{}\", totalStock, newPreStock, avaStock);\n throw new Exception(\"库存扣减放异常，可用库存+预占库存与总库存数量不符合\");\n }\n\n tempStock = new StockDemo();\n tempStock.setId(stock.getId());\n // 旧库 总库存和预占库存\n tempStock.setTotalStock(totalStock);\n tempStock.setPreStock(stock.getPreStock());\n // 新库存 总库存和预占库存\n tempStock.setNewPreStock(newPreStock);\n tempStock.setNewTotalStock(newTotalStock);\n\n // tempStock.setAvaStock(stock.getAvaStock());\n // System.out.println(\"更新的===========：\" + tempStock);\n //尝试CAS，先比较旧值，再更新\n if (optStock(tempStock) > 0)\n {\n // 总库存减成功\n log.info(\"总库存减成功，订单号：{}，减库存数量：{}\", stockDemo.getOrderNo(), productNum);\n outHourse = true;\n // 订单已完成\n this.updateOrderStatus(stockDemo.getOrderNo(), 2);\n break;\n }\n else\n {\n // 库存释放与预期的值不对，更新失败，尝试重新更新\n log.info(\"总库存更新与预期的值不对，库存出库扣减失败，尝试重新更新！\");\n // tryPreTimes++;\n stock = stockDemoMapper.queryByProduct(productNo, shopCode, secureRandom.nextInt(9999));\n }\n }\n // 可用库存\n tempStock.setAvaStock(stock.getAvaStock());\n tempStock.setNewAvaStock(stock.getAvaStock());\n\n // 预占成功处理日志\n return saveChangeLog(stockDemo, productNo, shopCode, stock, tempStock, outHourse, StockOptTypeEnum.OUT_WAREHOUSE_STOCK);\n }\n else\n {\n // 此处需要考虑下单失败后，补偿下单扣库存的\n log.error(\"库存出库扣减失败，获取不到锁!\");\n throw new Exception(\"库存出库扣减失败，获取不到锁\");\n }\n }\n catch (Exception e)\n {\n log.error(\"库存出库扣减失败!\");\n }\n finally\n {\n fairLock.unlock();\n }\n return 0;\n }\n\n /**\n * [简要描述]:添加总库存 res = fairLock.tryLockAsync(50, 10, TimeUnit.SECONDS);\n try\n {\n //final boolean lock = fairLock.tryLock(50, 10, TimeUnit.SECONDS);\n if (res.get())\n {\n // 校验\n StockDemo stock = stockDemoMapper\n .queryByProduct(stockDemo.getProductNo(), stockDemo.getShopCode(), secureRandom.nextInt(999));\n if (null == stock)\n {\n // 如果不存在直接抛异常扣库存失败\n log.error(\"商品不存在库存信息：{}\", stockDemo);\n return 0;\n }\n StockDemo tempStock = null;\n boolean addStatus = false;\n // 重试次数，5次更新机会\n while (null != stock)\n {\n int avaStock = stock.getAvaStock();\n int totalStock = stock.getTotalStock();\n int productNum = stockDemo.getProductNum();\n\n //可用+，总库存+\n int newAvaStock = avaStock + productNum;\n int newTotalStock = totalStock + productNum;\n\n int preStock = stock.getPreStock();\n // 预占+可用应该永远是=总库存的。即使总库存真实的减了，预占库存应该会对应的减\n if (newAvaStock + preStock != newTotalStock)\n {\n log.error(\"库存扣减异常，可用库存+预占库存与总库存数量不符合!总库存：{}，预占库存：{}，可用库存：{}\", totalStock, preStock, newAvaStock);\n throw new Exception(\"库存扣减放异常，可用库存+预占库存与总库存数量不符合\");\n }\n\n tempStock = new StockDemo();\n tempStock.setId(stock.getId());\n // 旧库 总库存和预占库存\n tempStock.setTotalStock(totalStock);\n tempStock.setPreStock(stock.getPreStock());\n tempStock.setAvaStock(avaStock);\n // 新库存 总库存和预占库存\n tempStock.setNewPreStock(stock.getPreStock());\n tempStock.setNewTotalStock(newTotalStock);\n tempStock.setNewAvaStock(newAvaStock);\n\n //System.out.println(\"更新的===========：\" + tempStock);\n //尝试CAS，先比较旧值，再更新\n if (optStock(tempStock) > 0)\n {\n // 总库存减成功\n log.info(\"总库存添加成功功，添加数量：{}，总库存存数量：{}\", productNum, newTotalStock);\n addStatus = true;\n break;\n }\n else\n {\n // 库存释放与预期的值不对，更新失败，尝试重新更新\n log.info(\"总库存更新与预期的值不对，更新失败，尝试重新更新！\");\n // tryPreTimes++;\n stock = stockDemoMapper.queryByProduct(productNo, shopCode, secureRandom.nextInt(9999));\n }\n }\n\n // 预占成功处理日志\n return saveChangeLog(stockDemo, productNo, shopCode, stock, tempStock, addStatus, StockOptTypeEnum.OUT_WAREHOUSE_STOCK);\n }\n else\n {\n // 此处需要考虑下单失败后，补偿下单扣库存的\n log.error(\"库存释放失败，获取不到锁!\");\n throw new Exception(\"库存释放失败，获取不到锁\");\n }\n }\n catch (Exception e)\n {\n log.error(\"库存释放失败!错误消息：\", e.getMessage());\n }\n finally\n {\n fairLock.unlock();\n }\n return 0;\n }\n\n /**\n * 获取订单信息\n *\n * @param orderNo\n * @return\n */\n @Override\n public OrderDemo getOrderByNo(String orderNo)\n {\n return orderDemoMapper.getOrderByNo(orderNo);\n }\n\n @Transactional(rollbackFor = Exception.class, propagation = Propagation.REQUIRES_NEW)\n public int optStock(StockDemo updateStock)\n {\n return stockDemoMapper.preStock(updateStock);\n }\n\n private boolean checkStock(StockDemo stockDemo, String optType)\n {\n if (null == stockDemo || StringUtils.isBlank(stockDemo.getOrderNo()) || StringUtils\n .isBlank(stockDemo.getShopCode()) || StringUtils.isBlank(stockDemo.getProductNo()))\n {\n // 参数为直接抛异常扣库存失败\n log.error(\"请求参数为空：{}\", stockDemo);\n return true;\n }\n\n StockChangeLodDemo stockChangeLodDemo = stockChangeLodDemoMapper\n .selectByOrderNo(stockDemo.getOrderNo(), stockDemo.getProductNo(), optType);\n if (null != stockChangeLodDemo)\n {\n log.error(\"预占库存失败，库存日志记录已经存在，订单号：{}，商品SKU：{}\", stockDemo.getOrderNo(), stockDemo.getProductNo());\n return true;\n }\n return false;\n }\n\n @Transactional(rollbackFor = Exception.class, propagation = Propagation.REQUIRES_NEW)\n public long saveChangeLog(StockDemo stockDemo, String productNo, String shopCode, StockDemo stock,\n StockDemo tempStock, boolean release, StockOptTypeEnum optTypeEnum) throws Exception\n {\n if (release)\n {\n tempStock.setProductNo(stockDemo.getProductNo());\n tempStock.setShopCode(stockDemo.getShopCode());\n tempStock.setOrderNo(stockDemo.getOrderNo());\n return saveStockChangeLog(tempStock, optTypeEnum);\n }\n else\n {\n log.error(\"下单失败，可用库存不足，单号：{}，店铺：{}\", stockDemo.getOrderNo(), shopCode);\n log.error(\"商品：{}，预占库存：{}\", productNo, stockDemo.getProductNum());\n throw new Exception(\"下单失败，库存不足!\");\n }\n }\n\n private Long saveStockChangeLog(StockDemo stockDemo, StockOptTypeEnum stockOptTypeEnum)\n {\n StockChangeLodDemo stockChangeLodDemo = new StockChangeLodDemo();\n stockChangeLodDemo.setOrderNo(stockDemo.getOrderNo());\n stockChangeLodDemo.setProductNo(stockDemo.getProductNo());\n stockChangeLodDemo.setShopCode(stockDemo.getShopCode());\n stockChangeLodDemo.setAvaStockBefore(stockDemo.getAvaStock());\n stockChangeLodDemo.setPreStockBefore(stockDemo.getPreStock());\n stockChangeLodDemo.setTotalStockBefore(stockDemo.getTotalStock());\n stockChangeLodDemo.setAvaStockAfter(stockDemo.getNewAvaStock());\n stockChangeLodDemo.setPreStockAfter(stockDemo.getNewPreStock());\n stockChangeLodDemo.setTotalStockAfter(stockDemo.getNewTotalStock());\n stockChangeLodDemo.setOptType(stockOptTypeEnum.getOptType());\n // System.out.println(\"保存日志：\" + stockChangeLodDemo);\n stockChangeLodDemoMapper.insert(stockChangeLodDemo);\n return stockChangeLodDemo.getId();\n }\n}\n"
},
{
"path": "SpringBoot-Stock-Demo/src/main/java/com/xiao/stock/demo/util/OrderNoUtil.java",
"content": "package com.xiao.stock.demo.util;\n\nimport cn.hutool.core.lang.Snowflake;\nimport cn.hutool.core.net.NetUtil;\nimport cn.hutool.core.util.IdUtil;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.stereotype.Component;\n\n/**\n * 订单枷锁工具\n */\n@Component\n@Slf4j\npublic class OrderNoUtil\n{\n private static long workerId = 0;\n private static Snowflake snowflake;\n\n static\n {\n try\n {\n\n workerId = NetUtil.ipv4ToLong(NetUtil.getLocalhostStr());\n }\n catch (Exception e)\n {\n log.warn(\"获取机器 ID 失败\", e);\n workerId = NetUtil.getLocalhost().hashCode();\n }\n workerId = workerId % 32;\n log.info(\"当前机器 workerId: {}\", workerId);\n // workerId 0~31\n snowflake = IdUtil.createSnowflake(workerId, workerId + 1);\n }\n\n public synchronized long snowflakeId()\n {\n return snowflake.nextId();\n }\n\n public synchronized long snowflakeId(long workerId, long dataCenterId)\n {\n Snowflake snowflake = IdUtil.createSnowflake(workerId, dataCenterId);\n return snowflake.nextId();\n }\n\n /**\n * 订单编号规则：14位毫秒时间戳+3位顺序编号\n *\n * @return\n */\n public String buildOrderNo()\n {\n return \"O\" + snowflakeId();\n }\n\n public String buildOrderItemNo()\n {\n return \"OI\" + snowflakeId();\n }\n\n /**\n * 快递单号\n *\n * @return\n */\n public String buildDeliveryNo()\n {\n return \"D\" + snowflakeId();\n }\n\n /**\n * 预售单号\n *\n * @return\n */\n public String buildAdvanceSaleOrderNo()\n {\n return \"Y\" + snowflakeId();\n }\n\n /**\n * 跨境购生成单号\n *\n * @return\n */\n public String buildHaitaoOrderNo()\n {\n return \"H\" + snowflakeId();\n }\n\n /**\n * [简要描述]:内购会生成订单,由I变更为O，便于识别\n \n \n \n \n \n \n \n \n \n \n \n \n id, order_no, shop_code, product_no, product_num,status, update_time\n \n \n \n select\n \n from t_order_demo\n where id = #{id,jdbcType=BIGINT}\n \n\n \n select\n \n from t_order_demo\n where order_no = #{orderNo,jdbcType=VARCHAR}\n \n\n \n \n delete from t_order_demo\n where id = #{id,jdbcType=BIGINT}\n \n \n \n insert into t_order_demo (id, order_no, shop_code,\n product_no, product_num,status, update_time\n )\n values (#{id,jdbcType=BIGINT}, #{orderNo,jdbcType=VARCHAR}, #{shopCode,jdbcType=VARCHAR},\n #{productNo,jdbcType=VARCHAR}, #{productNum,jdbcType=INTEGER},#{status,jdbcType=VARCHAR}, #{updateTime,jdbcType=TIMESTAMP}\n )\n \n \n \n insert into t_order_demo\n \n \n id,\n \n \n order_no,\n \n \n shop_code,\n \n \n product_no,\n \n \n product_num,\n \n \n status,\n \n \n update_time,\n \n \n \n \n #{id,jdbcType=BIGINT},\n \n \n #{orderNo,jdbcType=VARCHAR},\n \n \n #{shopCode,jdbcType=VARCHAR},\n \n \n #{productNo,jdbcType=VARCHAR},\n \n \n #{productNum,jdbcType=INTEGER},\n \n \n #{status,jdbcType=INTEGER},\n \n \n #{updateTime,jdbcType=TIMESTAMP},\n \n \n \n \n \n update t_order_demo\n \n \n order_no = #{orderNo,jdbcType=VARCHAR},\n \n \n shop_code = #{shopCode,jdbcType=VARCHAR},\n \n \n product_no = #{productNo,jdbcType=VARCHAR},\n \n \n product_num = #{productNum,jdbcType=INTEGER},\n \n \n status = #{status,jdbcType=INTEGER},\n \n \n update_time = #{updateTime,jdbcType=TIMESTAMP},\n \n \n where id = #{id,jdbcType=BIGINT}\n \n \n \n update t_order_demo\n set order_no = #{orderNo,jdbcType=VARCHAR},\n shop_code = #{shopCode,jdbcType=VARCHAR},\n product_no = #{productNo,jdbcType=VARCHAR},\n product_num = #{productNum,jdbcType=INTEGER},\n update_time = #{updateTime,jdbcType=TIMESTAMP},\n status = #{status,jdbcType=INTEGER}\n where id = #{id,jdbcType=BIGINT}\n \n\n \n update t_order_demo set status = #{status} where order_no = #{orderNo}\n \n "
},
{
"path": "SpringBoot-Stock-Demo/src/main/resources/com/xiao/stock/demo/mapper/StockChangeLodDemoMapper.xml",
"content": "\n\n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n id, product_no, shop_code, order_no, opt_type, pre_stock_after, ava_stock_after, total_stock_after,\n pre_stock_before, ava_stock_before, total_stock_before, update_time\n \n \n \n select\n \n from t_stock_change_log_demo\n where id = #{id,jdbcType=BIGINT}\n \n \n \n delete from t_stock_change_log_demo\n where id = #{id,jdbcType=BIGINT}\n \n \n \n insert into t_stock_change_log_demo (id, product_no, shop_code,\n order_no,opt_type, pre_stock_after, ava_stock_after,\n total_stock_after, pre_stock_before, ava_stock_before,\n total_stock_before, update_time)\n values (#{id,jdbcType=BIGINT}, #{productNo,jdbcType=VARCHAR}, #{shopCode,jdbcType=VARCHAR},\n #{orderNo,jdbcType=VARCHAR},#{optType,jdbcType=VARCHAR}, #{preStockAfter,jdbcType=INTEGER},\n #{avaStockAfter,jdbcType=INTEGER},\n #{totalStockAfter,jdbcType=INTEGER}, #{preStockBefore,jdbcType=INTEGER}, #{avaStockBefore,jdbcType=INTEGER},\n #{totalStockBefore,jdbcType=INTEGER}, #{updateTime,jdbcType=TIMESTAMP})\n \n \n \n insert into t_stock_change_log_demo\n \n \n id,\n \n \n product_no,\n \n \n shop_code,\n \n \n order_no,\n \n \n opt_type,\n \n \n pre_stock_after,\n \n \n ava_stock_after,\n \n \n total_stock_after,\n \n \n pre_stock_before,\n \n \n ava_stock_before,\n \n \n total_stock_before,\n \n \n update_time,\n \n \n \n \n #{id,jdbcType=BIGINT},\n \n \n #{productNo,jdbcType=VARCHAR},\n \n \n #{shopCode,jdbcType=VARCHAR},\n \n \n #{orderNo,jdbcType=VARCHAR},\n \n \n #{optType,jdbcType=VARCHAR},\n \n \n #{preStockAfter,jdbcType=INTEGER},\n \n \n #{avaStockAfter,jdbcType=INTEGER},\n \n \n #{totalStockAfter,jdbcType=INTEGER},\n \n \n #{preStockBefore,jdbcType=INTEGER},\n \n \n #{avaStockBefore,jdbcType=INTEGER},\n \n \n #{totalStockBefore,jdbcType=INTEGER},\n \n \n #{updateTime,jdbcType=TIMESTAMP},\n \n \n \n \n \n update t_stock_change_log_demo\n \n \n product_no = #{productNo,jdbcType=VARCHAR},\n \n \n shop_code = #{shopCode,jdbcType=VARCHAR},\n \n \n order_no = #{orderNo,jdbcType=VARCHAR},\n \n \n opt_type = #{optType,jdbcType=VARCHAR},\n \n \n pre_stock_after = #{preStockAfter,jdbcType=INTEGER},\n \n \n ava_stock_after = #{avaStockAfter,jdbcType=INTEGER},\n \n \n total_stock_after = #{totalStockAfter,jdbcType=INTEGER},\n \n \n pre_stock_before = #{preStockBefore,jdbcType=INTEGER},\n \n \n ava_stock_before = #{avaStockBefore,jdbcType=INTEGER},\n \n \n total_stock_before = #{totalStockBefore,jdbcType=INTEGER},\n \n \n update_time = #{updateTime,jdbcType=TIMESTAMP},\n \n \n where id = #{id,jdbcType=BIGINT}\n \n \n \n update t_stock_change_log_demo\n set product_no = #{productNo,jdbcType=VARCHAR},\n shop_code = #{shopCode,jdbcType=VARCHAR},\n order_no = #{orderNo,jdbcType=VARCHAR},\n opt_type = #{optType,jdbcType=VARCHAR},\n pre_stock_after = #{preStockAfter,jdbcType=INTEGER},\n ava_stock_after = #{avaStockAfter,jdbcType=INTEGER},\n total_stock_after = #{totalStockAfter,jdbcType=INTEGER},\n pre_stock_before = #{preStockBefore,jdbcType=INTEGER},\n ava_stock_before = #{avaStockBefore,jdbcType=INTEGER},\n total_stock_before = #{totalStockBefore,jdbcType=INTEGER},\n update_time = #{updateTime,jdbcType=TIMESTAMP}\n where id = #{id,jdbcType=BIGINT}\n \n\n \n \n select\n \n from t_stock_change_log_demo\n where order_no = #{orderNo,jdbcType=VARCHAR}\n and product_no = #{productNo,jdbcType=VARCHAR}\n and opt_type = #{optType,jdbcType=VARCHAR}\n \n "
},
{
"path": "SpringBoot-Stock-Demo/src/main/resources/com/xiao/stock/demo/mapper/StockDemoMapper.xml",
"content": "\n\n\n \n \n \n \n \n \n \n \n \n \n \n \n id, product_no, shop_code, pre_stock, ava_stock, total_stock, update_time\n \n \n \n select\n \n from t_stock_demo\n where id = #{id,jdbcType=BIGINT}\n \n \n select\n \n from t_stock_demo\n where product_no = #{productNo} and shop_code = #{shopCode}\n and ('random' = #{random} or 1 = 1)\n \n \n \n delete from t_stock_demo\n where id = #{id,jdbcType=BIGINT}\n \n \n \n insert into t_stock_demo (id, product_no, shop_code,\n pre_stock, ava_stock, total_stock,\n update_time)\n values (#{id,jdbcType=BIGINT}, #{productNo,jdbcType=VARCHAR}, #{shopCode,jdbcType=VARCHAR},\n #{preStock,jdbcType=INTEGER}, #{avaStock,jdbcType=INTEGER}, #{totalStock,jdbcType=INTEGER},\n #{updateTime,jdbcType=TIMESTAMP})\n \n \n \n insert into t_stock_demo\n \n \n id,\n \n \n product_no,\n \n \n shop_code,\n \n \n pre_stock,\n \n \n ava_stock,\n \n \n total_stock,\n \n \n update_time,\n \n \n \n \n #{id,jdbcType=BIGINT},\n \n \n #{productNo,jdbcType=VARCHAR},\n \n \n #{shopCode,jdbcType=VARCHAR},\n \n \n #{preStock,jdbcType=INTEGER},\n \n \n #{avaStock,jdbcType=INTEGER},\n \n \n #{totalStock,jdbcType=INTEGER},\n \n \n #{updateTime,jdbcType=TIMESTAMP},\n \n \n \n \n \n update t_stock_demo\n \n \n product_no = #{productNo,jdbcType=VARCHAR},\n \n \n shop_code = #{shopCode,jdbcType=VARCHAR},\n \n \n pre_stock = #{preStock,jdbcType=INTEGER},\n \n \n ava_stock = #{avaStock,jdbcType=INTEGER},\n \n \n total_stock = #{totalStock,jdbcType=INTEGER},\n \n \n update_time = #{updateTime,jdbcType=TIMESTAMP},\n \n \n where id = #{id,jdbcType=BIGINT}\n \n \n \n update t_stock_demo\n set product_no = #{productNo,jdbcType=VARCHAR},\n shop_code = #{shopCode,jdbcType=VARCHAR},\n pre_stock = #{preStock,jdbcType=INTEGER},\n ava_stock = #{avaStock,jdbcType=INTEGER},\n total_stock = #{totalStock,jdbcType=INTEGER},\n update_time = #{updateTime,jdbcType=TIMESTAMP}\n where id = #{id,jdbcType=BIGINT}\n \n\n \n update t_stock_demo\n \n \n ava_stock = #{newAvaStock,jdbcType=INTEGER},\n \n \n pre_stock = #{newPreStock,jdbcType=INTEGER},\n \n \n total_stock = #{newTotalStock,jdbcType=INTEGER},\n \n \n \n id = #{id,jdbcType=BIGINT}\n \n and ava_stock = #{avaStock,jdbcType=INTEGER}\n \n \n and pre_stock = #{preStock,jdbcType=INTEGER}\n \n \n and total_stock = #{totalStock,jdbcType=INTEGER}\n \n \n \n "
},
{
"path": "SpringBoot-Stock-Demo/src/main/resources/logback-spring.xml",
"content": "\n\n \n \n \n \n \n \n \n \n \n %d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level %logger{50} - %msg%n \n \n \n\n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n \n \n \n\n "
},
{
"path": "SpringCloud-Canal/doc/ServerRunningMonitor源码注解.md",
"content": "设计到主要知识点:\n 1. Zookeeper 临时节点创建\n 2. CAS 操作\n 3. MDC 线程安全的存放诊断日志的容器\n\n```html\npublic ServerRunningMonitor(){\n // 创建父节点\n IZkDataListener dataListener = new IZkDataListener() {\n\n // ZK节点数据出现变更，比如：主动释放、激活、新增等\n public void handleDataChange(String dataPath, Object data) throws Exception {\n // 线程安全的存放诊断日志的容器,其实是放到当前线程的ThreadLocalMap中，不明所以？\n MDC.put(\"destination\", destination);\n ServerRunningData runningData = JsonUtils.unmarshalFromByte((byte[]) data, ServerRunningData.class);\n\n // 如果不是本机节点\n if (!isMine(runningData.getAddress())) {\n // 互斥设置false，内部使用CAS操作\n mutex.set(false);\n }\n\n // zk上现有节点不活跃，且zk的节点是本机节点，说明是主动释放\n if (!runningData.isActive() && isMine(runningData.getAddress())) { // 说明出现了主动释放的操作，并且本机之前是active\n release = true;\n // 从zk上删除节点\n releaseRunning();// 彻底释放mainstem\n }\n\n // 设置当前活动节点为zk上正在运行的节点\n activeData = (ServerRunningData) runningData;\n }\n\n // 节点删除\n public void handleDataDeleted(String dataPath) throws Exception {\n MDC.put(\"destination\", destination);\n // 互斥设置false，内部使用CAS操作\n mutex.set(false);\n\n // 不为释放状态、活动节点不会为空且为本机节点，则即时触发一下active抢占\n if (!release && activeData != null && isMine(activeData.getAddress())) {\n initRunning();\n } else {\n // 否则就是等待delayTime，避免因网络瞬端或者zk异常，导致出现频繁的切换操作\n delayExector.schedule(new Runnable() {\n public void run() {\n initRunning();\n }\n }, delayTime, TimeUnit.SECONDS);\n }\n }\n\n };\n\n }\n \n private void initRunning() {\n \n // 不是运行中直接返回\n if (!isStart()) {\n return;\n }\n \n // 生产当前运行的实例的节点信息：/otter/canal/destinations/{0} 实例信息如example\n String path = ZookeeperPathUtils.getDestinationServerRunning(destination);\n // 序列化 当前运行的节点，此处应该是本机的节点\n byte[] bytes = JsonUtils.marshalToByte(serverData);\n try {\n // 互斥false CAS操作 阻塞?\n mutex.set(false);\n // ZK上创建临时节点(带open ACL)并设置数据\n zkClient.create(path, bytes, CreateMode.EPHEMERAL);\n activeData = serverData;\n // 触发激活事件\n processActiveEnter();\n // 设置互斥 CAS操作，释放一下锁对象，唤醒一下阻塞的Thread\n mutex.set(true);\n } catch (ZkNodeExistsException e) {\n // 节点已经存在，或去数据\n bytes = zkClient.readData(path, true);\n if (bytes == null) {\n // 节点中的数据为空，则立即出发抢占\n initRunning();\n } else {\n // 反之设置当前可用节点为ZK上的节点\n activeData = JsonUtils.unmarshalFromByte(bytes, ServerRunningData.class);\n }\n } catch (ZkNoNodeException e) {\n // 不存在则创建父节点，尝试抢占动作\n zkClient.createPersistent(ZookeeperPathUtils.getDestinationPath(destination), true);\n initRunning();\n }\n }\n\n```"
},
{
"path": "SpringCloud-Canal/pom.xml",
"content": "\n\n \n SpringCloud-Demo \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n SpringCloud-Canal \n\n \n\n \n org.springframework.boot \n spring-boot-starter-web \n \n\n \n \n com.alibaba.otter \n canal.client \n 1.1.2 \n \n\n \n \n com.lmax \n disruptor \n 3.4.2 \n \n\n \n org.projectlombok \n lombok \n ${lombok.version} \n \n\n \n \n cn.hutool \n hutool-core \n 4.1.12 \n \n\n \n\n "
},
{
"path": "SpringCloud-Canal/readme.md",
"content": "1. 本DEMO主要实现：Canal+disruptor+springboot，订阅mysql binlog日志，实现数据同步，比如缓存，ES等。 entrys)\n {\n if (log.isDebugEnabled())\n {\n log.debug(\"接收到需要处理数据，总数量：{}\", entrys.size());\n }\n \n List tableDataList = new ArrayList<>(entrys.size());\n // 表名\n String tableName;\n TableData tableData;\n CanalEntry.RowChange rowChange;\n for (CanalEntry.Entry entry : entrys)\n {\n // 事物数据不处理\n if (entry.getEntryType() == CanalEntry.EntryType.TRANSACTIONBEGIN\n || entry.getEntryType() == CanalEntry.EntryType.TRANSACTIONEND)\n {\n continue;\n }\n \n if (entry.getEntryType() != CanalEntry.EntryType.ROWDATA)\n {\n continue;\n }\n \n //获取表名\n tableName = entry.getHeader().getTableName();\n \n //仅处理部分表接口数据\n if (tableNames.contains(tableName))\n {\n try\n {\n rowChange = CanalEntry.RowChange.parseFrom(entry.getStoreValue());\n // RowData --具体insert/update/delete的变更数据，可为多条，1个binlog event事件可对应多条变更，比如批处理\n for (CanalEntry.RowData rowData : rowChange.getRowDatasList())\n {\n switch (rowChange.getEventType())\n {\n //当前仅处理Insert和更新数据\n case INSERT:\n case UPDATE:\n tableData = new TableData();\n tableData.setTableName(tableName);\n tableData.setId(parseKey(rowData.getAfterColumnsList()));\n tableDataList.add(tableData);\n break;\n default:\n break;\n }\n }\n }\n catch (Exception e)\n {\n log.error(\"当前行数据解析错误：\", e);\n }\n }\n }\n if (CollectionUtil.isNotEmpty(tableDataList))\n {\n //发送数据到异步队列框架\n disruptorProducer.send(tableDataList);\n }\n if (log.isDebugEnabled())\n {\n log.debug(\"接收到Mysql更新数据，总数量：{}\", tableDataList.size());\n }\n }\n ```\n\n4. Canal使用——数据库初始化配置（5.* 必须） entrys)\n {\n for (CanalEntry.Entry entry : entrys)\n {\n // 事物数据不处理\n if (entry.getEntryType() == CanalEntry.EntryType.TRANSACTIONBEGIN\n || entry.getEntryType() == CanalEntry.EntryType.TRANSACTIONEND)\n {\n continue;\n }\n\n if (entry.getEntryType() != CanalEntry.EntryType.ROWDATA)\n {\n continue;\n }\n\n System.out.println(\"Db name:\" + entry.getHeader().getSchemaName());\n System.out.println(\"table name: \" + entry.getHeader().getTableName());\n\n CanalEntry.RowChange rowChange = null;\n try\n {\n rowChange = CanalEntry.RowChange.parseFrom(entry.getStoreValue());\n }\n catch (Exception e)\n {\n throw new RuntimeException(\n \"ERROR ## parser of eromanga-event has an error,data:\" + entry.toString(), e);\n }\n\n //是否是ddl变更操作，比如create table/drop table\n if (rowChange.getIsDdl())\n {\n //具体的ddl sql\n System.out.println(rowChange.getSql());\n }\n\n // RowData --具体insert/update/delete的变更数据，可为多条，1个binlog event事件可对应多条变更，比如批处理\n for (CanalEntry.RowData rowData : rowChange.getRowDatasList())\n {\n //insert只有after columns, delete只有before columns，而update则会有before / after columns数据.\n //变更前的字段数据\n List beforeColumns = rowData.getBeforeColumnsList();\n //变更后的字段数据\n List afterColumns = rowData.getAfterColumnsList();\n\n switch (rowChange.getEventType())\n {\n case INSERT:\n case UPDATE:\n System.out.print(\"UPSERT \");\n printColumns(rowData.getAfterColumnsList());\n\n if (\"retl_buffer\".equals(entry.getHeader().getTableName()))\n {\n String tableName = rowData.getAfterColumns(1).getValue();\n String pkValue = rowData.getAfterColumns(2).getValue();\n System.out.println(\"SELECT * FROM \" + tableName + \" WHERE id = \" + pkValue);\n }\n break;\n\n case DELETE:\n System.out.print(\"DELETE \");\n printColumns(rowData.getBeforeColumnsList());\n break;\n case QUERY:\n System.out.println(rowChange.getSql());\n default:\n break;\n }\n }\n }\n }\n\n /**\n * index\n * \n * sqlType [jdbc type]\n *
\n * name [字段名]\n *
\n * isKey [是否为主键]\n *
\n * updated [是否发生过变更]\n *
\n * isNull [值是否为null]\n *
\n * value [具体的内容，注意为string文本]\n *\n * @param columns\n */\n private static void printColumns(List columns)\n {\n // 获取操作后完整的整条记录\n String line = columns.stream().map(column -> column.getName() + \"=\" + column.getValue())\n .collect(Collectors.joining(\",\"));\n System.out.println(line);\n }\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/CanalSimpleApplication.java",
"content": "package com.xiao.springcloud;\n\nimport org.springframework.boot.SpringApplication;\nimport org.springframework.boot.autoconfigure.SpringBootApplication;\n\n/**\n * [简要描述]: Canal+Disruptor 集成到springboot 案列\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/27 09:00\n * @since JDK 1.8\n */\n@SpringBootApplication\npublic class CanalSimpleApplication\n{\n public static void main(String[] args)\n {\n SpringApplication.run(CanalSimpleApplication.class, args);\n }\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/canal/CanalClientService.java",
"content": "package com.xiao.springcloud.canal;\n\nimport cn.hutool.core.collection.CollectionUtil;\nimport com.alibaba.otter.canal.client.CanalConnector;\nimport com.alibaba.otter.canal.client.CanalConnectors;\nimport com.alibaba.otter.canal.protocol.CanalEntry;\nimport com.alibaba.otter.canal.protocol.Message;\nimport com.alibaba.otter.canal.protocol.exception.CanalClientException;\nimport com.xiao.springcloud.disruptor.DisruptorProducer;\nimport com.xiao.springcloud.disruptor.DisruptorThreadFactory;\nimport com.xiao.springcloud.disruptor.TableData;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.beans.factory.DisposableBean;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.context.ApplicationListener;\nimport org.springframework.context.event.ContextRefreshedEvent;\nimport org.springframework.stereotype.Component;\n\nimport java.net.InetSocketAddress;\nimport java.util.*;\nimport java.util.concurrent.*;\nimport java.util.stream.Collectors;\nimport java.util.stream.Stream;\n\n/**\n * [简要描述]: Canal客户端服务\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 15:27\n * @since JDK 1.8\n */\n@Component\n@Slf4j\npublic class CanalClientService implements DisposableBean, ApplicationListener\n{\n\n private CanalConfig canalConfig;\n\n // disruptor异步队列\n private DisruptorProducer disruptorProducer;\n\n //定时任务检查 canal连接状态\n private ScheduledExecutorService scheduledExecutorService;\n\n //canal线程处理，不阻塞springboot主流程\n private ExecutorService canalExecutor;\n\n private static volatile boolean start;\n\n private CanalConnector connector;\n\n //需要监听过滤的一些表\n private static Set tableNames = new HashSet<>();\n\n static\n {\n //初始化一些需要监听的表\n tableNames.add(\"t_table_test\");\n }\n\n @Autowired\n public CanalClientService(CanalConfig canalConfig, DisruptorProducer disruptorProducer)\n {\n this.canalConfig = canalConfig;\n this.disruptorProducer = disruptorProducer;\n }\n\n @Override\n public void destroy() throws Exception\n {\n log.error(\">>> 即将关闭Canal连接，销毁线程池.....\");\n if (start)\n {\n try\n {\n connector.disconnect();\n }\n catch (CanalClientException e)\n {\n log.error(\">>> 关闭Canal连接异常：\", e);\n }\n }\n canalExecutor.shutdown();\n scheduledExecutorService.shutdown();\n }\n\n @Override\n public void onApplicationEvent(ContextRefreshedEvent contextRefreshedEvent)\n {\n\n log.info(\">>> Canal启动......\");\n init();\n // 执行启动\n canalExecutor.execute(() -> start());\n // 启动后5S开始检查connector的状态，每个2两分钟执行一次\n scheduledExecutorService.scheduleAtFixedRate(() -> check(), 1, 2, TimeUnit.MINUTES);\n\n }\n\n private void start()\n {\n try\n {\n connector.connect();\n connector.subscribe(canalConfig.getListenerDb() + \"\\\\..*\");\n start = true;\n log.info(\">>> Canal连接成功，订阅DB：{}下所有表信息\", canalConfig.getListenerDb());\n }\n catch (CanalClientException e)\n {\n log.error(\">>> Canal服务连接失败：\", e);\n start = false;\n }\n\n if (start)\n {\n processBinlog();\n }\n }\n\n private void processBinlog()\n {\n //每一次拉取100条数据\n int batchSize = 100;\n Message msg;\n while (true)\n {\n try\n {\n msg = connector.getWithoutAck(batchSize);\n long batchId = msg.getId();\n int size = msg.getEntries().size();\n //没有数据，休眠5秒\n if (batchId < 0 || size == 0)\n {\n try\n {\n Thread.sleep(5000);\n }\n catch (InterruptedException e)\n {\n log.error(\">>> 休眠线程中断.......\");\n }\n }\n else\n {\n // 数据处理\n processData(msg.getEntries());\n }\n connector.ack(batchId);\n }\n catch (Exception e)\n {\n // 客户端异常，中断当前循环，等待定时任务重连操作\n log.error(\">>> Canal 客户端异常，中断操作，并断开现有连接，等待定时任务定期重连操作...\", e);\n this.close();\n break;\n }\n }\n }\n\n private void processData(List entrys)\n {\n if (log.isDebugEnabled())\n {\n log.debug(\"接收到需要处理数据，总数量：{}\", entrys.size());\n }\n\n List tableDataList = new ArrayList<>(entrys.size());\n // 表名\n String tableName;\n TableData tableData;\n CanalEntry.RowChange rowChange;\n for (CanalEntry.Entry entry : entrys)\n {\n // 事物数据不处理\n if (entry.getEntryType() == CanalEntry.EntryType.TRANSACTIONBEGIN\n || entry.getEntryType() == CanalEntry.EntryType.TRANSACTIONEND)\n {\n continue;\n }\n\n if (entry.getEntryType() != CanalEntry.EntryType.ROWDATA)\n {\n continue;\n }\n\n //获取表名\n tableName = entry.getHeader().getTableName();\n\n //仅处理部分表接口数据\n if (tableNames.contains(tableName))\n {\n try\n {\n rowChange = CanalEntry.RowChange.parseFrom(entry.getStoreValue());\n // RowData --具体insert/update/delete的变更数据，可为多条，1个binlog event事件可对应多条变更，比如批处理\n // insert 只有after数据，delete只有 before数据，update会有after和before数据\n for (CanalEntry.RowData rowData : rowChange.getRowDatasList())\n {\n switch (rowChange.getEventType())\n {\n //当前仅处理Insert和更新数据\n case INSERT:\n case UPDATE:\n tableData = new TableData();\n tableData.setTableName(tableName);\n tableData.setId(parseKey(rowData.getAfterColumnsList()));\n tableDataList.add(tableData);\n break;\n default:\n break;\n }\n }\n }\n catch (Exception e)\n {\n log.error(\"当前行数据解析错误：\", e);\n }\n }\n }\n if (CollectionUtil.isNotEmpty(tableDataList))\n {\n //发送数据到异步队列框架\n disruptorProducer.send(tableDataList);\n }\n if (log.isDebugEnabled())\n {\n log.debug(\"接收到Mysql更新数据，总数量：{}\", tableDataList.size());\n }\n }\n\n /**\n * 解析主键KEY\n * sqlType [jdbc type]\n *
\n * name [字段名]\n *
\n * isKey [是否为主键]\n *
\n * updated [是否发生过变更]\n *
\n * isNull [值是否为null]\n *
\n * value [具体的内容，注意为string文本]\n *\n * @param columns\n */\n private Long parseKey(List columns)\n {\n // 获取操作后完整的整条记录\n String line = columns.stream().map(column -> column.getName() + \"=\" + column.getValue())\n .collect(Collectors.joining(\",\"));\n //只保留主键Key的数据\n Stream columnStream = columns.stream().filter(column -> column.getIsKey());\n // 返回第一个数据\n Optional first = columnStream.findFirst();\n return Long.parseLong(first.get().getValue());\n }\n\n private void check()\n {\n if (log.isDebugEnabled())\n {\n log.debug(\">>> 开始执行检测Canal连接状态...\");\n }\n if (!start)\n {\n log.warn(\">>> 开始执行重连Canal服务...\");\n this.start();\n }\n }\n\n private void init()\n {\n log.info(\">>> 初始化Canal连接信息.......\");\n int threads = Runtime.getRuntime().availableProcessors();\n scheduledExecutorService = new ScheduledThreadPoolExecutor(threads, DisruptorThreadFactory\n .create(\"Scheduled check Canal connector-\", true));\n\n canalExecutor = Executors.newSingleThreadExecutor(DisruptorThreadFactory.create(\"Canal servers-\", true));\n\n if (canalConfig.isCluster())\n {\n log.info(\">>> 建立ZK集群Canal连接信息：{}\", canalConfig.getZkServers());\n connector = CanalConnectors\n .newClusterConnector(canalConfig.getZkServers(), canalConfig.getDestination(), canalConfig\n .getUserName(), canalConfig.getPassword());\n }\n else\n {\n log.info(\">>> 建立单Canal连接信息：{}\", canalConfig.getHostName());\n connector = CanalConnectors.newSingleConnector(new InetSocketAddress(canalConfig.getHostName(), canalConfig\n .getPort()), canalConfig.getDestination(), canalConfig.getUserName(), canalConfig.getPassword());\n }\n }\n\n private void close()\n {\n try\n {\n if (start)\n {\n connector.disconnect();\n }\n }\n catch (CanalClientException e)\n {\n log.error(\"关闭Canal连接错误：\", e);\n }\n finally\n {\n start = false;\n }\n\n }\n\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/canal/CanalConfig.java",
"content": "package com.xiao.springcloud.canal;\n\nimport lombok.Data;\nimport org.springframework.beans.factory.annotation.Value;\nimport org.springframework.context.annotation.Configuration;\n\n/**\n * [简要描述]: Canal服务配置\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 15:18\n * @since JDK 1.8\n */\n@Configuration\n@Data\npublic class CanalConfig\n{\n @Value(\"${spring.cache.server.cluster:false}\")\n private boolean cluster;\n\n @Value(\"${spring.cache.server.hostName:localhost}\")\n private String hostName;\n\n @Value(\"${spring.cache.server.port:11111}\")\n private int port;\n\n @Value(\"${spring.cache.server.destination:example}\")\n private String destination;\n\n @Value(\"${spring.cache.server.userName:}\")\n private String userName;\n\n @Value(\"${spring.cache.server.password:}\")\n private String password;\n\n @Value(\"${spring.cache.server.zkServers:}\")\n private String zkServers;\n\n @Value(\"${spring.cache.server.dbName:}\")\n private String listenerDb;\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/DataEvent.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport lombok.Data;\n\n/**\n * [简要描述]: 定义事件\n * [详细描述]:通过 Disruptor 进行交换的数据类型\n *\n * @author llxiao\n * @version 1.0, 2019/3/21 15:12\n * @since JDK 1.8\n */\n@Data\npublic class DataEvent\n{\n private TableData data;\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/DataEventFactory.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport com.lmax.disruptor.EventFactory;\n\n/**\n * [简要描述]: 定义事件工厂\n * [详细描述]: 定义了如何实例化定义的事件(Event)\n * Disruptor 通过 EventFactory 在 RingBuffer 中预创建 Event 的实例\n * 一个 Event 实例实际上被用作一个“数据槽”，发布者发布前，先从 RingBuffer 获得一个 Event 的实例，然后往 Event 实例中填充数据，\n{\n @Override\n public DataEvent newInstance()\n {\n return new DataEvent();\n }\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/DisruptorConsumer.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport com.lmax.disruptor.EventHandler;\nimport com.lmax.disruptor.WorkHandler;\nimport com.xiao.springcloud.disruptor.service.DisruptorService;\nimport lombok.extern.slf4j.Slf4j;\n\nimport java.util.concurrent.Executor;\n\n/**\n * [简要描述]: Disruptor消费者之Handler。\n * [详细描述]:\n * , WorkHandler\n{\n //具体的服务\n private DisruptorService disruptorService;\n\n /**\n *\n */\n private final Executor executor;\n\n public DisruptorConsumer(DisruptorService disruptorService, Executor executor)\n {\n this.disruptorService = disruptorService;\n this.executor = executor;\n }\n\n @Override\n public void onEvent(DataEvent dataEvent) throws Exception\n {\n if (log.isDebugEnabled())\n {\n log.info(\"接受到数据更新请求 >>>\" + dataEvent);\n }\n executor.execute(() ->\n {\n disruptorService.execute(dataEvent.getData());\n });\n\n }\n\n @Override\n public void onEvent(DataEvent dataEvent, long sequence, boolean endOfBatch) throws Exception\n {\n if (log.isDebugEnabled())\n {\n log.info(\"接受到数据更新请求 >>>{}\", dataEvent);\n log.info(\"Sequence:{}\", sequence);\n log.info(\"End Of Batch：{}\", endOfBatch);\n }\n this.onEvent(dataEvent);\n }\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/DisruptorExceptionHandler.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport com.lmax.disruptor.ExceptionHandler;\nimport com.xiao.springcloud.disruptor.service.DisruptorService;\nimport lombok.extern.slf4j.Slf4j;\n\n/**\n * [简要描述]: Disruptor自定义异常处理\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/21 15:42\n * @since JDK 1.8\n */\n@Slf4j\npublic class DisruptorExceptionHandler implements ExceptionHandler\n{\n private DisruptorService disruptorService;\n\n public DisruptorExceptionHandler(DisruptorService disruptorService)\n {\n this.disruptorService = disruptorService;\n }\n\n /**\n * 事件处理异常\n */\n @Override\n public void handleEventException(Throwable throwable, long sequence, DataEvent dataEvent)\n {\n //事件处理异常里面进行补偿执行\n disruptorService.execute(dataEvent.getData());\n log.error(\">>> Disruptor事件处理异常，进行立即执行补偿操作..........\");\n log.error(\">>> 异常信息如下：\", throwable.getMessage());\n }\n\n /**\n * 启动异常\n *\n * @param throwable\n */\n @Override\n public void handleOnStartException(Throwable throwable)\n {\n log.error(\">>> Disruptor 启动异常：{}\", throwable.getMessage());\n }\n\n /**\n * 关闭异常\n *\n * @param throwable\n */\n @Override\n public void handleOnShutdownException(Throwable throwable)\n {\n log.error(\">>> Disruptro 关闭异常：{}\", throwable.getMessage());\n }\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/DisruptorProducer.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport cn.hutool.core.collection.CollectionUtil;\nimport com.lmax.disruptor.EventTranslatorOneArg;\nimport com.lmax.disruptor.RingBuffer;\nimport com.lmax.disruptor.WaitStrategy;\nimport com.lmax.disruptor.YieldingWaitStrategy;\nimport com.lmax.disruptor.dsl.Disruptor;\nimport com.lmax.disruptor.dsl.ProducerType;\nimport com.xiao.springcloud.disruptor.service.DisruptorService;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.beans.factory.DisposableBean;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.context.ApplicationListener;\nimport org.springframework.context.event.ContextRefreshedEvent;\nimport org.springframework.stereotype.Component;\n\nimport java.util.List;\nimport java.util.concurrent.*;\n\n/**\n * [简要描述]: Disruptor生产者\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/21 15:37\n * @since JDK 1.8\n */\n@Component\n@Slf4j\npublic class DisruptorProducer implements DisposableBean, ApplicationListener\n{\n /**\n * RingBuffer 大小，必须是 2 的 N 次方；\n */\n private int ringBufferSize = 1024 * 1024;\n\n private Disruptor disruptor;\n\n private boolean isMultiProducer;\n\n /**\n * 等待策略\n * 例如，BlockingWaitStrategy、SleepingWaitStrategy、YieldingWaitStrategy 等，其中，\n * BlockingWaitStrategy 是最低效的策略，但其对CPU的消耗最小并且在各种不同部署环境中能提供更加一致的性能表现；\n * SleepingWaitStrategy 的性能表现跟 BlockingWaitStrategy 差不多，对 CPU 的消耗也类似，但其对生产者线程的影响最小，适合用于异步日志类似的场景；\n * YieldingWaitStrategy 的性能是最好的，适合用于低延迟的系统。在要求极高性能且事件处理线数小于 CPU 逻辑核心数的场景中，推荐使用此策略；例如，CPU开启超线程的特性。\n */\n private WaitStrategy waitStrategy;\n\n private RingBuffer ringBuffer;\n\n private volatile boolean isStart;\n\n private DisruptorService disruptorService;\n\n private ExecutorService executor;\n private int threads;\n\n @Autowired\n public DisruptorProducer(DisruptorService disruptorService)\n {\n\n threads = Runtime.getRuntime().availableProcessors();\n this.disruptorService = disruptorService;\n\n //单生产者\n isMultiProducer = true;\n ProducerType producerType = ProducerType.SINGLE;\n if (isMultiProducer)\n {\n //多生产者\n producerType = ProducerType.MULTI;\n }\n // 等待策略\n waitStrategy = new YieldingWaitStrategy();\n\n //初始化disruptor\n disruptor = new Disruptor<>(new DataEventFactory(), ringBufferSize, DisruptorThreadFactory\n .create(\"Disruptor Main-\", false), producerType, waitStrategy);\n\n executor = new ThreadPoolExecutor(threads, threads, 0, TimeUnit.MILLISECONDS, new LinkedBlockingQueue<>(), DisruptorThreadFactory\n .create(\"Disruptor Producer-\", false), new ThreadPoolExecutor.AbortPolicy());\n }\n\n /**\n * [简要描述]:发送事件处理 dataList)\n {\n if (log.isDebugEnabled())\n {\n log.debug(\"批量发送数据给消费者，总数量：{}\", CollectionUtil.isNotEmpty(dataList) ? 0 : dataList.size());\n }\n if (CollectionUtil.isNotEmpty(dataList))\n {\n executor.execute(() ->\n {\n for (TableData tableData : dataList)\n {\n translator(tableData);\n }\n });\n }\n }\n\n private void translator(TableData tableData)\n {\n EventTranslatorOneArg eventTranslatorOneArg = (event, sequence, message1) -> event\n .setData(tableData);\n ringBuffer.publishEvent(eventTranslatorOneArg, tableData);\n }\n\n @Override\n public void destroy() throws Exception\n {\n if (isStart)\n {\n //关闭 disruptor，方法会堵塞，直至所有的事件都得到处理；\n disruptor.shutdown();\n }\n executor.shutdown();\n }\n\n @Override\n public void onApplicationEvent(ContextRefreshedEvent contextRefreshedEvent)\n {\n log.info(\">>> Disruptor producer 启动......\");\n doStart();\n }\n\n private void doStart()\n {\n //CPU可使用数量\n final Executor executor = new ThreadPoolExecutor(threads, threads, 0, TimeUnit.MILLISECONDS, new LinkedBlockingQueue<>(), DisruptorThreadFactory\n .create(\"Disruptor consumer-\", false), new ThreadPoolExecutor.AbortPolicy());\n DisruptorConsumer[] disruptorConsumers = new DisruptorConsumer[threads];\n for (int i = 0; i < threads; i++)\n {\n disruptorConsumers[i] = new DisruptorConsumer(disruptorService, executor);\n }\n //设置消费者Handler\n // 广播 消费者之间无依赖关系\n // disruptor.handleEventsWith(ArrayUtil.toArray(handlers, EventHandler.class));\n // 关闭 消费间有依赖关系,假设：2号需要在0号和1号处理完才能进行\n // disruptor.handleEventsWith(handlers.get(0),handlers.get(1)).then(handlers.get(2));\n // 分组 List workHandlers\n disruptor.handleEventsWithWorkerPool(disruptorConsumers);\n\n //设置异常处理\n disruptor.setDefaultExceptionHandler(new DisruptorExceptionHandler(disruptorService));\n\n ringBuffer = disruptor.start();\n this.isStart = true;\n }\n\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/DisruptorThreadFactory.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport java.util.concurrent.ThreadFactory;\nimport java.util.concurrent.atomic.AtomicLong;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 14:49\n * @since JDK 1.8\n */\npublic class DisruptorThreadFactory implements ThreadFactory\n{\n private static final AtomicLong THREAD_NUMBER = new AtomicLong(1);\n\n private static final ThreadGroup THREAD_GROUP = new ThreadGroup(\"disruptor\");\n\n private static volatile boolean daemon;\n\n private final String namePrefix;\n\n private DisruptorThreadFactory(final String namePrefix, final boolean daemon)\n {\n this.namePrefix = namePrefix;\n DisruptorThreadFactory.daemon = daemon;\n }\n\n /**\n * Constructs a new {@code Thread}. Implementations may also initialize\n * priority, name, daemon status, {@code ThreadGroup}, etc.\n *\n * @param r a runnable to be executed by new thread instance\n * @return constructed thread, or {@code null} if the request to\n * create a thread is rejected\n */\n @Override\n public Thread newThread(Runnable r)\n {\n Thread thread = new Thread(THREAD_GROUP, r,\n THREAD_GROUP.getName() + \"-\" + namePrefix + \"-\" + THREAD_NUMBER.getAndIncrement());\n thread.setDaemon(daemon);\n if (thread.getPriority() != Thread.NORM_PRIORITY)\n {\n thread.setPriority(Thread.NORM_PRIORITY);\n }\n return thread;\n }\n\n /**\n * 自定义线程factory\n *\n * @param namePrefix\n * @param daemon\n * @return\n */\n public static ThreadFactory create(final String namePrefix, final boolean daemon)\n {\n return new DisruptorThreadFactory(namePrefix, daemon);\n }\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/TableData.java",
"content": "package com.xiao.springcloud.disruptor;\n\nimport lombok.Data;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 09:48\n * @since JDK 1.8\n */\n@Data\npublic class TableData\n{\n /**\n * 主键ID\n */\n private Long id;\n\n /**\n * 表名\n */\n private String tableName;\n}\n"
},
{
"path": "SpringCloud-Canal/src/main/java/com/xiao/springcloud/disruptor/service/DisruptorService.java",
"content": "package com.xiao.springcloud.disruptor.service;\n\nimport com.xiao.springcloud.disruptor.TableData;\n\n/**\n * [简要描述]: 异步队列服务\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 09:50\n * @since JDK 1.8\n */\npublic interface DisruptorService\n{\n /**\n * [简要描述]:异步处理服务\n{\n\n /**\n * [简要描述]:异步处理服务\n 4.0.0 \n \n com.xiao.skywalking.demo \n SpringCloud-Demo \n 0.0.1-SNAPSHOT \n \n SpringCloud-Common \n jar \n\n \n 3.4.2 \n \n\n \n \n org.springframework.boot \n spring-boot-starter-web \n \n \n \n org.slf4j \n slf4j-log4j12 \n \n \n \n \n org.springframework.boot \n spring-boot-starter-aop \n \n \n org.springframework.cloud \n spring-cloud-starter-feign \n \n \n org.projectlombok \n lombok \n true \n \n \n \n cn.hutool \n hutool-core \n 4.1.12 \n \n \n \n com.alibaba \n fastjson \n 1.2.83 \n \n \n org.apache.commons \n commons-lang3 \n 3.4 \n \n \n commons-collections \n commons-collections \n 3.2.2 \n \n\n \n org.redisson \n redisson \n 3.5.7 \n \n\n \n \n com.google.guava \n guava \n 29.0-jre \n \n \n org.springframework.boot \n spring-boot-starter-cache \n \n\n \n com.lmax \n disruptor \n ${disruptor.version} \n \n \n\n "
},
{
"path": "SpringCloud-Common/script/auto_deploy.sh",
"content": "#!/bin/bash\n\n## jenkins 自动部署脚本 jekins 项目 Post Steps设置 启动该脚本，配置如下：\n# BUILD_ID=DONTKILLME\n# bash /home/omni-services/remote-deploy/auto_deploy.sh\n\nSERVICE_NAME=content-management-service\nJARPATH=/root/.jenkins/workspace/$SERVICE_NAME-perf/target/$SERVICE_NAME.jar\necho \"service name:$SERVICE_NAME\"\nSERVICE_HOME=/home/omni-services/$SERVICE_NAME\nJARFILE=$SERVICE_HOME/$SERVICE_NAME.jar\nBOOTSTRAP_FILE=$SERVICE_HOME/bootstrap.sh\n\necho \"=====service name: $SERVICE_NAME\"\necho \"=====service home: $SERVICE_HOME\"\necho \"=====service resouce jar path: $JARPATH\"\necho \"=====service bootstrap file: $BOOTSTRAP_FILE\"\necho \"=====service jar: $JARFILE\"\n\n## 停止原来的服务\necho \"-----Stop service\"\nbash $BOOTSTRAP_FILE stop\n\n## 备份原来的Jar包\necho \"-----Bach source jar file: $JARFILE\"\nmv $JARFILE $SERVICE_HOME/$SERVICE_NAME-`date \"+%Y-%m-%d %H:%M:%S\"`.jar\n\n## 复制新包\necho \"-----Copy $JARPATH to $SERVICE_HOME\"\ncp $JARPATH $SERVICE_HOME\nCOPYRULST=$?\n\n## 复制OK，开始启动\nif [ $COPYRULST -eq 0 ]; \nthen\n echo \"-----Copy success,wait start service.....\"\n bash $BOOTSTRAP_FILE start\n RETVAL=$?\n if [ $RETVAL -eq 0 ];\n then\n echo \"-----$SERVICE_NAME started!\"\n else\n echo \"-----$SERVICE_NAME start failed!\"\n fi\nelse\n echo \"-----Not exist $SERVICE_NAME jar\"\n exit 1\nfi\n\n\n"
},
{
"path": "SpringCloud-Common/script/bootstrap.sh",
"content": "#!/bin/bash\n## 加载配置，避免获取不到java_home \nsource /etc/profile\n\nSERVICE_NAME=appname\nSERVICE_HOME=/home/admin/services\nPROG=$SERVICE_HOME/$SERVICE_NAME\nPIDFILE=$SERVICE_HOME/$SERVICE_NAME/$SERVICE_NAME.pid\ncd $SERVICE_HOME/$SERVICE_NAME\n\n# skywalking探针参数\nSKYWALKING_AGENT_PATH=/home/admin/agent/skywalking-agent.jar\nSKYWALKING_SERVCIE_NAME=$SERVICE_NAME\n\n# GC参数\nLOG_TIMESTAMP=`date \"+%Y%m%d%H%M%S\"`\nLOG_HOME=/data/logs/$SERVICE_NAME\nOOM_FILE=$LOG_HOME/oom-$LOG_TIMESTAMP.hprof\nGC_FILE=$LOG_HOME/gc-$LOG_TIMESTAMP.log\n\n\n#堆配置：服务模式(启动慢，一次编译，运行效率高)、最小内存512m、最大内存512m、年轻代大512m\nHEAP_OPTIONS=\"-server -Xms512m -Xmx512m -Xmn256m\"\n#栈配置：设置每个线程的栈大小，DK5.0以后每个线程栈大小为1M，依据实际情况设定。较少的值内存能生成更多的线程（受系统限制），较大的值可（如2M）能会再一定程度上降低性能。\n#STACKS_OPTIONS=-Xss128K\n## GC配置：gc详情、gc时间、gc日志文件位置、gc堆栈信息\nGC_OPTIONS=\"-XX:+PrintGCDetails -XX:+PrintGCTimeStamps -Xloggc:$SERVICE_HOME/$SERVICE_NAME_gc.log -XX:+PrintHeapAtGC\"\n## gc收集器：Java提供串行收集器、并行收集器、并发收集器三种，串行收集器只适用于小数据量的情况，并行收集器主要以到达一定的吞吐量为目标\n# 并行垃圾收集器：配置仅对年轻代有效、并行线程数20(建议与处理器数目相等)\nGC_COLLECTOR_PARAL=\"-XX:+UseParallelGC -XX:ParallelGCThreads=4 -XX:+UseParallelOldGC\"\n## 老年代垃圾收集器：年老代垃圾收集方式为并行收集(1.6以后支持)\n# CMS垃圾收集器：初始标记->并发标记->并发预清理->重新标记->并发清理->并发重置(标记-清理 算法),CMS默认在老年代空间使用68%时候启动垃圾回收。可以通过-XX:CMSinitiatingOccupancyFraction=n来设置这个阀值。\n#GC_COLLECTOR_CMS=\"-XX:+UseConcMarkSweepGC -XX:ParallelCMSThreads=4\"\n## oom配置：OOM时导出堆到文件、导出OOM的路径\n#-XX:OnOutOfMemoryError=D:/tools/jdk1.7_40/bin/printstack.bat %p //p代表的是当前进程的pid ，即当程序OOM时，在D:/a.txt中将会生成线程的dump。\nOOM_OPTIONS=\"-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=$SERVICE_HOME/$SERVICE_NAME.dump\"\n## 类加载监控\n#CLASS_LOAD_MONITOR=\"-XX:+TraceClassLoading -XX:+PrintClassHistogram\"\n## 其他配置：新生的转老年代GC次数、禁止程序GC、set/get使用本地方法、加快编译、锁机制的性能改善\n#OTHER_OPTIONS=\"-XX:MaxTenuringThreshold=15 -XX:+DisableExplicitGC -XX:+UseFastAccessorMethods -XX:+AggressiveOpts -XX:+UseBiasedLocking\"\n## jvm 参数配置\nJAVA_OPTS=\"$HEAP_OPTIONS $GC_OPTIONS $GC_COLLECTOR_PARAL $OOM_OPTIONS\"\n\n\ncd $SERVICE_HOME\n\nstatus() {\n if [ -f $PIDFILE ]; then\n PID=$(cat $PIDFILE)\n if [ ! -x /proc/${PID} ]; then\n return 1\n else\n return 0\n fi\n else\n return 1\n fi\n}\n\ncase \"$1\" in\n start)\n status\n RETVAL=$?\n if [ $RETVAL -eq 0 ]; then\n echo \"-----$PIDFILE exists, process is already running or crashed\"\n exit 1\n fi\n\n ##检测 java环境\n if [ ! -n $JAVA_HOME ]; then\n echo \"-----Please check JAVA_HOME!\"\n echo \"-----Exit\"\n exit 1\n else\n echo \"-----Jave home: $JAVA_HOME\"\n echo \"-----Starting $PROG ...\"\n echo \"-----Java options: $JAVA_OPTS\"\n #nohup java $JAVA_OPTS -jar $JARFILE > $LOG_FILE 2>&1 &\n # GC参数+skywalking探针设置\n nohup java -server -Xms2048m -Xmx2048m -XX:CMSInitiatingOccupancyFraction=80 -XX:+UseCMSInitiatingOccupancyOnly -XX:SurvivorRatio=8 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=$OOM_FILE -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -Xloggc:$GC_FILE -javaagent:$SKYWALKING_AGENT_PATH -Dskywalking.agent.service_name=$SKYWALKING_SERVCIE_NAME -jar $SERVICE_HOME/$SERVICE_NAME/$SERVICE_NAME.jar > $SERVICE_NAME.log 2>&1 &\n\n RETVAL=$?\n if [ $RETVAL -eq 0 ]; then\n echo \"-----$PROG is started\"\n echo $! > $PIDFILE\n exit 0\n else\n echo \"-----Stopping $PROG\"\n rm -f $PIDFILE\n exit 1\n fi\n fi\n ;;\n stop)\n status\n RETVAL=$?\n if [ $RETVAL -eq 0 ]; then\n echo \"-----Shutting down $PROG\"\n kill -9 `cat $PIDFILE`\n RETVAL=$?\n if [ $RETVAL -eq 0 ]; then\n LS_DATE=`date +%Y%m%d`\n BACK_LOG=$SERVICE_NAME-$LS_DATE.log\n BACK_LOG_FILE=$SERVICE_HOME/$BACK_LOG\n ## 备份日志文件\n if [ -f \"$BACK_LOG_FILE\" ]; then\n echo \"-----Back log file $BACK_LOG exist and copy log to back file!\"\n echo \"--------------------------------------------------------------------------------------------------------------------\" >> $BACK_LOG\n echo `date \"+%Y-%m-%d %H:%M:%S\"` >> $BACK_LOG\n echo \"-----------------------------------------重新启动-------------------------------------------------------------------\" >> $BACK_LOG\n cat $LOG_FILE >> $BACK_LOG\n ## 删除日志文件\n rm -f $LOG_FILE\n else\n echo \"-----Back log file to $BACK_LOG....\"\n mv $LOG_FILE $BACK_LOG\n fi\n ## 删除Pid文件\n rm -f $PIDFILE\n else\n echo \"-----Failed to stopping $PROG\"\n fi\n fi\n ;;\n status)\n status\n RETVAL=$?\n if [ $RETVAL -eq 0 ]; then\n PID=$(cat $PIDFILE)\n echo \"-----$PROG is running ($PID)\"\n else\n echo \"-----$PROG is not running\"\n fi\n ;;\n restart)\n $0 stop\n $0 start\n ;;\n *)\n echo \"Usage: $0 {start|stop|restart|status}\"\n ;;\nesac\n"
},
{
"path": "SpringCloud-Common/script/remote_deploy.sh",
"content": "#!/bin/bash\n\n## jenkins 自动部远程署脚本，需要配置两个服务器之间免密登录\n## 免登陆配置参考：https://blog.csdn.net/u011186019/article/details/51737760?utm_source=blogxgwz4\n##jekins 项目 Post Steps设置 启动该脚本，配置如下：\n#BUILD_ID=DONTKILLME -- 表示Jenkins执行完后不杀死该进程，否则会再jenkins执行完后杀死启动的进程\n#bash /home/omni-services/remote-deploy/remote-deploy.sh\n\nSERVICE_NAME=appname\nREMOTE_SERVICES_HOME=/home/services\nREMOTE_SERVICE_IP=目标服务器IP\nREMOTE_SERVICE_HOME=$REMOTE_SERVICES_HOME/$SERVICE_NAME\n##服务jar\nREMOTE_SERVICE_JAR=$REMOTE_SERVICE_HOME/$SERVICE_NAME.jar\n##启动脚本\nREMOTE_SERVICE_BOOTSTRAP=$REMOTE_SERVICE_HOME/bootstrap.sh\n##jenkins编译完成后服务Jar包位置\nLOCAL_JAR_PATH=/root/.jenkins/workspace/$SERVICE_NAME-perf/target/$SERVICE_NAME.jar\n\necho \"=============Service name: $SERVICE_NAME\"\necho \"=============Remote services home: $REMOTE_SERVICES_HOME\"\necho \"=============Remote server ip: $REMOTE_SERVICE_IP\"\necho \"=============Remote service home: $REMOTE_SERVICE_HOME\"\necho \"=============Remote service jar: $REMOTE_SERVICE_JAR\"\necho \"=============Remote service bootstrap file: $REMOTE_SERVICE_BOOTSTRAP\"\n\n## 远程操作，停止并备份原来的服务\necho \"-----Stop and Delete remote service: $SERVICE_NAME\"\nssh -T root@$REMOTE_SERVICE_IP << remotessh\nsh $REMOTE_SERVICE_BOOTSTRAP stop\nmv $REMOTE_SERVICE_JAR $REMOTE_SERVICE_HOME/$SERVICE_NAME-`date \"+%Y-%m-%d %H:%M:%S\"`.jar\nexit\nremotessh\n\n##复制一份新的服务Jar\necho \"-----Scp $LOCAL_JAR_PATH to $REMOTE_SERVICE_HOME\"\nscp $LOCAL_JAR_PATH root@$REMOTE_SERVICE_IP:$REMOTE_SERVICE_HOME \n\n##远程启动服务\necho \"-----Start remote service\"\nssh -T root@$REMOTE_SERVICE_IP << remotessh\nsh $REMOTE_SERVICE_BOOTSTRAP start\nexit\nremotessh\n\nexit\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/SkywalkingService.java",
"content": "/*\n * Winner \n * 文件名 :SkywalkingService.java\n * 创建人 :llxiao\n * 创建时间:2018年3月29日\n*/\n\npackage com.xiao.springcloud.demo.common;\n\n/**\n * [简要描述]: \n com.google.guava \n guava \n 25.1-jre \n \n \n org.springframework.boot \n spring-boot-starter-cache \n \n```\n2. 代码方法上使用\n```\n@Cacheable(value = \"methodName\", key = \"'methodName'.concat({#param1}).concat({#parma2})\")\n```\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/cache/code/FastJsonCodec.java",
"content": "package com.xiao.springcloud.demo.common.cache.code;\n\nimport com.alibaba.fastjson.JSON;\nimport com.alibaba.fastjson.serializer.SerializerFeature;\nimport io.netty.buffer.ByteBuf;\nimport io.netty.buffer.ByteBufAllocator;\nimport io.netty.buffer.ByteBufInputStream;\nimport io.netty.buffer.ByteBufOutputStream;\nimport lombok.extern.slf4j.Slf4j;\nimport org.redisson.client.codec.Codec;\nimport org.redisson.client.handler.State;\nimport org.redisson.client.protocol.Decoder;\nimport org.redisson.client.protocol.Encoder;\n\nimport java.io.IOException;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author zhdong\n * @version 1.0, 2018/9/20\n * @since JDK 1.8\n */\n@Slf4j\npublic class FastJsonCodec implements Codec\n{\n\n public static final FastJsonCodec INSTANCE = new FastJsonCodec();\n private Encoder encoder = null;\n private Decoder decoder = null;\n private Encoder keyEncoder = null;\n private Decoder keyDecoder = null;\n\n public FastJsonCodec()\n {\n this.encoder = new Encoder()\n {\n public ByteBuf encode(Object in) throws IOException\n {\n ByteBuf out = ByteBufAllocator.DEFAULT.buffer();\n try\n {\n SerializerObject serial = new SerializerObject(in);\n ByteBufOutputStream os = new ByteBufOutputStream(out);\n\n JSON.writeJSONString(os, serial, SerializerFeature.WriteMapNullValue, //是否输出值为null的字段,默认为false\n SerializerFeature.DisableCircularReferenceDetect, //消除循环引用\n SerializerFeature.WriteClassName,//写入类名便于序列化解析\n SerializerFeature.WriteNullStringAsEmpty);\n return os.buffer();\n }\n catch (IOException var4)\n {\n out.release();\n throw var4;\n }\n }\n };\n this.decoder = new Decoder()\n {\n public Object decode(ByteBuf buf, State state) throws IOException\n {\n SerializerObject serial = JSON.parseObject(new ByteBufInputStream(buf), SerializerObject.class);\n return serial.getValue();\n }\n };\n\n this.keyEncoder = new Encoder()\n {\n public ByteBuf encode(Object in) throws IOException\n {\n ByteBuf out = ByteBufAllocator.DEFAULT.buffer();\n try\n {\n ByteBufOutputStream os = new ByteBufOutputStream(out);\n JSON.writeJSONString(os, in);\n return os.buffer();\n }\n catch (IOException var4)\n {\n out.release();\n throw var4;\n }\n }\n };\n\n this.keyDecoder = new Decoder()\n {\n public Object decode(ByteBuf buf, State state) throws IOException\n {\n return JSON.parseObject(new ByteBufInputStream(buf), String.class);\n }\n };\n\n }\n\n @Override\n public Decoder getMapValueDecoder()\n {\n return decoder;\n }\n\n @Override\n public Encoder getMapValueEncoder()\n {\n return encoder;\n }\n\n @Override\n public Decoder getMapKeyDecoder()\n {\n return keyDecoder;\n }\n\n @Override\n public Encoder getMapKeyEncoder()\n {\n return keyEncoder;\n }\n\n @Override\n public Decoder getValueDecoder()\n {\n return decoder;\n }\n\n @Override\n public Encoder getValueEncoder()\n {\n return encoder;\n }\n\n\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/cache/code/SerializerObject.java",
"content": "package com.xiao.springcloud.demo.common.cache.code;\n\nimport lombok.AllArgsConstructor;\nimport lombok.Builder;\nimport lombok.Data;\nimport lombok.NoArgsConstructor;\n\nimport java.io.Serializable;\n\n/**\n * [简要描述]: 使用fastjson序列化的类\n * [详细描述]:\n *\n * @author zhdong\n * @version 1.0, 2018/9/21\n * @since JDK 1.8\n */\n@Data\n@Builder\n@NoArgsConstructor\n@AllArgsConstructor\npublic class SerializerObject implements Serializable\n{\n\n private Object value;\n\n}\n\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/cache/conf/RedissonConfig.java",
"content": "package com.xiao.springcloud.demo.common.cache.conf;\n\nimport com.xiao.springcloud.demo.common.cache.code.FastJsonCodec;\nimport lombok.extern.slf4j.Slf4j;\nimport org.redisson.Redisson;\nimport org.redisson.api.RedissonClient;\nimport org.redisson.config.Config;\nimport org.redisson.connection.balancer.RoundRobinLoadBalancer;\nimport org.springframework.beans.factory.annotation.Value;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnProperty;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\n\nimport java.io.BufferedReader;\nimport java.io.IOException;\nimport java.io.InputStreamReader;\nimport java.net.URL;\nimport java.net.URLConnection;\n\n@Configuration\n@Slf4j\n// 属性值存在该配置才会生效\n@ConditionalOnProperty(name = RedissonConfig.REDISSON_FILE_NAME)\npublic class RedissonConfig\n{\n public static final String REDISSON_FILE_NAME = \"redisson.fileName\";\n\n @Value(\"${spring.cloud.config.uri:}\")\n private String configUrl;\n @Value(\"${spring.cloud.config.label:}\")\n private String label;\n @Value(\"${spring.cloud.config.profile:}\")\n private String profile;\n /* redissoin配置文件名称 */\n @Value(\"${redisson.fileName:redission}\")\n private String redissionFileName;\n\n // 配置中心读取ression.yml文件\n private String getYamlFromConfig() throws IOException\n {\n String uri = configUrl + label + \"/\" + redissionFileName + \"-\" + profile + \".yml\";\n log.info(\"redission配置文件uri:\" + uri);\n URL url = new URL(uri);\n URLConnection connection = url.openConnection();\n StringBuilder buffer = new StringBuilder();\n try (BufferedReader br = new BufferedReader(new InputStreamReader(connection.getInputStream())))\n {\n String msg = null;\n while ((msg = br.readLine()) != null)\n {\n buffer.append(msg).append(\"\\r\\n\");\n }\n }\n return buffer.toString();\n }\n\n @Bean\n public Config config() throws IOException\n {\n\n Config config = Config.fromYAML(getYamlFromConfig());\n if (config.isClusterConfig())\n {\n config.useClusterServers().setLoadBalancer(new RoundRobinLoadBalancer());\n }\n\n return config;\n }\n\n @Bean(destroyMethod = \"shutdown\")\n public RedissonClient redissonClient(Config config) throws IOException\n {\n log.info(\"create RedissonClient, config is : {}\", config.toJSON());\n\n //序列化统一使用fastjson\n config.setCodec(FastJsonCodec.INSTANCE);\n return Redisson.create(config);\n }\n\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/cache/dto/EntryDto.java",
"content": "package com.xiao.springcloud.demo.common.cache.dto;\n\nimport lombok.Data;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2018/10/15 17:18\n * @since JDK 1.8\n */\n@Data\npublic class EntryDto\n{\n private String key;\n private T value;\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/cache/local/SpringGuavaCacheConfig.java",
"content": "package com.xiao.springcloud.demo.common.cache.local;\n\nimport com.google.common.cache.CacheBuilder;\nimport org.springframework.cache.CacheManager;\nimport org.springframework.cache.guava.GuavaCacheManager;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\n\nimport java.util.concurrent.TimeUnit;\n\n/**\n * [简要描述]: guava+springcache实现本地缓存\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2018/9/29 17:28\n * @since JDK 1.8\n */\n@Configuration\npublic class SpringGuavaCacheConfig\n{\n @Bean\n public CacheManager cacheManager()\n {\n GuavaCacheManager cacheManager = new GuavaCacheManager();\n cacheManager\n // 3S过期时间，初始容量1000个，最大10000个\n .setCacheBuilder(CacheBuilder.newBuilder().expireAfterWrite(3, TimeUnit.SECONDS).initialCapacity(1000)\n .maximumSize(10000));\n return cacheManager;\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/cache/service/CacheService.java",
"content": "package com.xiao.springcloud.demo.common.cache.service;\n\nimport com.xiao.springcloud.demo.common.cache.dto.EntryDto;\n\nimport java.util.List;\nimport java.util.Map;\nimport java.util.Set;\n\n/**\n * [简要描述]: 缓存服务\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2018/10/11 13:45\n * @since JDK 1.8\n */\npublic interface CacheService\n{\n\n /**\n * [简要描述]:缓存中获取一个string> list);\n\n /**\n * [简要描述]:添加一个string到缓存 T getObject(String key);\n\n /**\n * [简要描述]:添加一个对象到缓存 void setObject(String key, T value);\n\n /**\n * [简要描述]:批量设置Object到缓存 void batchSetObj(List> objs);\n\n /**\n * [简要描述]:添加一个对象到缓存 void setObject(String key, T value, long leaseTime);\n\n /**\n * [简要描述]:从map中获取指定key的值 T hget(String key, String field);\n\n /**\n * [简要描述]:设置一个值到map中 void hset(String key, String field, T value);\n\n /**\n * [简要描述]:指定key的map Map hgetAll(String key);\n\n /**\n * [简要描述]:设置map集 void hsetAll(String key, Map maps);\n\n /**\n * [简要描述]:批量hset void batchHset(List>> maps);\n\n /**\n * [简要描述]:Set中添加一个元素 void addSet(String key, T value);\n\n /**\n * [简要描述]:获取一个set集合 Set getSet(String key);\n\n /**\n * [简要描述]:Set中移除一个元素 void removeSet(String key, T value);\n\n /**\n * [简要描述]:批量从缓存获取对象集合\n * llxiao 2018/10/15 - 10:00\n **/\n List batchGet(List keys);\n\n /**\n * [简要描述]:批量从缓存获取MAP集合\n * llxiao 2018/10/15 - 10:01\n **/\n List> batchGetMap(List keys);\n\n /**\n * [简要描述]:删除一个对象\n * Redisson内部提供了一个监控锁的看门狗，它的作用是在Redisson实例被关闭前，不断的延长锁的有效期。 bucket = redissonClient.getBucket(key);\n return bucket.get();\n }\n return \"\";\n }\n\n /**\n * [简要描述]:添加一个string到缓存 bucket = redissonClient.getBucket(key);\n bucket.set(value);\n }\n }\n\n /**\n * [简要描述]:批量设置string到缓存> list)\n {\n if (redissonClient != null && CollectionUtil.isNotEmpty(list))\n {\n RBatch batch = redissonClient.createBatch();\n for (EntryDto entry : list)\n {\n batch.getBucket(entry.getKey()).setAsync(entry.getValue());\n }\n batch.execute();\n }\n }\n\n /**\n * [简要描述]:添加一个string到缓存 bucket = redissonClient.getBucket(key);\n bucket.set(value, leaseTime, TimeUnit.SECONDS);\n }\n\n /**\n * [简要描述]:获取一个缓存对象 T getObject(String key)\n {\n RBucket bucket = redissonClient.getBucket(key);\n return null != bucket ? bucket.get() : null;\n }\n\n /**\n * [简要描述]:添加一个对象到缓存 void setObject(String key, T value)\n {\n RBucket bucket = redissonClient.getBucket(key);\n bucket.set(value);\n }\n\n /**\n * [简要描述]:批量设置Object到缓存 void batchSetObj(List> objs)\n {\n if (redissonClient != null && CollectionUtil.isNotEmpty(objs))\n {\n RBatch batch = redissonClient.createBatch();\n for (EntryDto entry : objs)\n {\n batch.getBucket(entry.getKey()).setAsync(entry.getValue());\n }\n batch.execute();\n }\n }\n\n /**\n * [简要描述]:添加一个对象到缓存 void setObject(String key, T value, long leaseTime)\n {\n RBucket bucket = redissonClient.getBucket(key);\n bucket.set(value, leaseTime, TimeUnit.SECONDS);\n }\n\n /**\n * [简要描述]: T hget(String key, String field)\n {\n RMap map = redissonClient.getMap(key);\n return map.get(field);\n }\n\n /**\n * [简要描述]:设置一个值到map中 void hset(String key, String field, T value)\n {\n RMap map = redissonClient.getMap(key);\n map.put(field, value);\n }\n\n /**\n * [简要描述]:指定key的map Map hgetAll(String key)\n {\n return (Map) redissonClient.getMap(key).readAllMap();\n }\n\n /**\n * [简要描述]:设置map集 void hsetAll(String key, Map maps)\n {\n RMap map = redissonClient.getMap(key);\n map.putAll(maps);\n }\n\n /**\n * [简要描述]:批量hset void batchHset(List>> maps)\n {\n if (null != redissonClient && CollectionUtil.isNotEmpty(maps))\n {\n RBatch batch = redissonClient.createBatch();\n for (EntryDto> entry : maps)\n {\n batch.getMap(entry.getKey()).putAllAsync(entry.getValue());\n }\n batch.execute();\n }\n }\n\n /**\n * [简要描述]:Set中添加一个元素 void addSet(String key, T value)\n {\n RSet set = redissonClient.getSet(key);\n set.add(value);\n }\n\n /**\n * [简要描述]:获取一个set集合 Set getSet(String key)\n {\n return (Set) redissonClient.getSet(key).readAll();\n }\n\n /**\n * [简要描述]:Set中移除一个元素 void removeSet(String key, T value)\n {\n redissonClient.getSet(key).remove(value);\n }\n\n /**\n * [简要描述]:批量从缓存获取对象集合\n * llxiao 2018/10/15 - 10:00\n **/\n @Override\n public List batchGet(List keys)\n {\n RBatch batch = redissonClient.createBatch();\n for (String key : keys)\n {\n batch.getBucket(key).getAsync();\n }\n BatchResult result = batch.execute();\n return result.getResponses();\n }\n\n /**\n * [简要描述]:批量从缓存获取MAP集合\n * llxiao 2018/10/15 - 10:01\n **/\n @Override\n public List> batchGetMap(List keys)\n {\n RBatch batch = redissonClient.createBatch();\n for (String key : keys)\n {\n batch.getMap(key).readAllMapAsync();\n }\n BatchResult result = batch.execute();\n return result.getResponses();\n }\n\n /**\n * [简要描述]:删除一个对象\n * Redisson内部提供了一个监控锁的看门狗，它的作用是在Redisson实例被关闭前，不断的延长锁的有效期。
\n * 一个 Event 实例实际上被用作一个“数据槽”，发布者发布前，先从 RingBuffer 获得一个 Event 的实例，然后往 Event 实例中填充数据，\n{\n @Override\n public DataEvent newInstance()\n {\n return new DataEvent();\n }\n}\n\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/DisruptorConsumer.java",
"content": "package com.xiao.springcloud.demo.common.disruptor;\n\nimport com.lmax.disruptor.EventHandler;\nimport com.lmax.disruptor.WorkHandler;\nimport com.xiao.springcloud.demo.common.disruptor.data.DataEvent;\nimport com.xiao.springcloud.demo.common.disruptor.service.DisruptorService;\nimport lombok.extern.slf4j.Slf4j;\n\nimport java.util.concurrent.Executor;\n\n/**\n * [简要描述]: Disruptor消费者之Handler。\n * [详细描述]:\n * , WorkHandler\n{\n //具体的服务\n private DisruptorService disruptorService;\n\n /**\n *\n */\n private final Executor executor;\n\n public DisruptorConsumer(DisruptorService disruptorService, Executor executor)\n {\n this.disruptorService = disruptorService;\n this.executor = executor;\n }\n\n @Override\n public void onEvent(DataEvent dataEvent) throws Exception\n {\n if (log.isDebugEnabled())\n {\n log.info(\"接受到数据更新请求 >>>\" + dataEvent);\n }\n executor.execute(() ->\n {\n disruptorService.execute(dataEvent.getBasisData());\n });\n\n }\n\n @Override\n public void onEvent(DataEvent dataEvent, long sequence, boolean endOfBatch) throws Exception\n {\n if (log.isDebugEnabled())\n {\n log.info(\"接受到数据更新请求 >>>{}\", dataEvent);\n log.info(\"Sequence:{}\", sequence);\n log.info(\"End Of Batch：{}\", endOfBatch);\n }\n this.onEvent(dataEvent);\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/DisruptorExceptionHandler.java",
"content": "package com.xiao.springcloud.demo.common.disruptor;\n\nimport com.lmax.disruptor.ExceptionHandler;\nimport com.xiao.springcloud.demo.common.disruptor.data.DataEvent;\nimport com.xiao.springcloud.demo.common.disruptor.service.DisruptorService;\nimport lombok.extern.slf4j.Slf4j;\n\n/**\n * [简要描述]: Disruptor自定义异常处理\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/21 15:42\n * @since JDK 1.8\n */\n@Slf4j\npublic class DisruptorExceptionHandler implements ExceptionHandler\n{\n private DisruptorService disruptorService;\n\n public DisruptorExceptionHandler(DisruptorService disruptorService)\n {\n this.disruptorService = disruptorService;\n }\n\n /**\n * 事件处理异常\n */\n @Override\n public void handleEventException(Throwable throwable, long sequence, DataEvent dataEvent)\n {\n //事件处理异常里面进行补偿执行\n disruptorService.execute(dataEvent.getBasisData());\n log.error(\">>> Disruptor事件处理异常，进行立即执行补偿操作..........\");\n log.error(\">>> 异常信息如下：\", throwable.getMessage());\n }\n\n /**\n * 启动异常\n *\n * @param throwable\n */\n @Override\n public void handleOnStartException(Throwable throwable)\n {\n log.error(\">>> Disruptor 启动异常：{}\", throwable.getMessage());\n }\n\n /**\n * 关闭异常\n *\n * @param throwable\n */\n @Override\n public void handleOnShutdownException(Throwable throwable)\n {\n log.error(\">>> Disruptro 关闭异常：{}\", throwable.getMessage());\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/DisruptorProducer.java",
"content": "package com.xiao.springcloud.demo.common.disruptor;\n\nimport com.lmax.disruptor.BlockingWaitStrategy;\nimport com.lmax.disruptor.EventTranslatorOneArg;\nimport com.lmax.disruptor.RingBuffer;\nimport com.lmax.disruptor.WaitStrategy;\nimport com.lmax.disruptor.dsl.Disruptor;\nimport com.lmax.disruptor.dsl.ProducerType;\nimport com.xiao.springcloud.demo.common.disruptor.data.BasisData;\nimport com.xiao.springcloud.demo.common.disruptor.data.DataEvent;\nimport com.xiao.springcloud.demo.common.disruptor.service.DisruptorService;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.beans.factory.DisposableBean;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.context.ApplicationListener;\nimport org.springframework.context.event.ContextRefreshedEvent;\nimport org.springframework.stereotype.Component;\n\nimport java.util.concurrent.*;\n\n/**\n * [简要描述]: Disruptor生产者\n * [详细描述]:\n * 严重警告：ringBufferSize的值设定需要保持理性的数量，环形队列是等着被替换而不是被回收，设置太大会撑爆你设定的JVM内存，最终导致OLD占满，接下来就是无限循环的FGC\n *\n * @author llxiao\n * @version 1.0, 2019/3/21 15:37\n * @since JDK 1.8\n */\n@Component\n@Slf4j\npublic class DisruptorProducer implements DisposableBean, ApplicationListener\n{\n /**\n * RingBuffer 大小，必须是 2 的 N 次方；\n */\n private int ringBufferSize = 1024 * 1024;\n\n private Disruptor disruptor;\n\n private boolean isMultiProducer;\n\n /**\n * 等待策略\n * 例如，BlockingWaitStrategy、SleepingWaitStrategy、YieldingWaitStrategy 等，其中，\n * BlockingWaitStrategy 是最低效的策略，但其对CPU的消耗最小并且在各种不同部署环境中能提供更加一致的性能表现；\n * SleepingWaitStrategy 的性能表现跟 BlockingWaitStrategy 差不多，对 CPU 的消耗也类似，但其对生产者线程的影响最小，适合用于异步日志类似的场景；\n * YieldingWaitStrategy 的性能是最好的，适合用于低延迟的系统。在要求极高性能且事件处理线数小于 CPU 逻辑核心数的场景中，推荐使用此策略；例如，CPU开启超线程的特性。\n */\n private WaitStrategy waitStrategy;\n\n private RingBuffer ringBuffer;\n\n public volatile boolean isStart;\n\n private DisruptorService disruptorService;\n\n private ExecutorService executor;\n private int threads;\n\n @Autowired\n public DisruptorProducer(DisruptorService disruptorService)\n {\n\n threads = Runtime.getRuntime().availableProcessors();\n this.disruptorService = disruptorService;\n\n //单生产者\n isMultiProducer = true;\n ProducerType producerType = ProducerType.SINGLE;\n if (isMultiProducer)\n {\n //多生产者\n producerType = ProducerType.MULTI;\n }\n // 等待策略\n // waitStrategy = new YieldingWaitStrategy();\n waitStrategy = new BlockingWaitStrategy();\n //初始化disruptor\n disruptor = new Disruptor<>(new DataEventFactory(), ringBufferSize, DisruptorThreadFactory\n .create(\"Disruptor Main-\", false), producerType, waitStrategy);\n\n executor = new ThreadPoolExecutor(threads, threads, 0, TimeUnit.MILLISECONDS, new LinkedBlockingQueue<>(), DisruptorThreadFactory\n .create(\"Disruptor Producer-\", false), new ThreadPoolExecutor.AbortPolicy());\n }\n\n /**\n * [简要描述]:发送事件处理 eventTranslatorOneArg = (event, sequence, message1) -> event\n .setBasisData(basisData);\n if (!this.isStart)\n {\n ringBuffer = disruptor.start();\n this.isStart = true;\n }\n ringBuffer.publishEvent(eventTranslatorOneArg, basisData);\n }\n\n @Override\n public void destroy() throws Exception\n {\n if (isStart)\n {\n //关闭 disruptor，方法会堵塞，直至所有的事件都得到处理；\n disruptor.shutdown();\n }\n executor.shutdown();\n }\n\n public void doStart()\n {\n //CPU可使用数量\n final Executor executor = new ThreadPoolExecutor(threads, threads, 0, TimeUnit.MILLISECONDS, new LinkedBlockingQueue<>(), DisruptorThreadFactory\n .create(\"Disruptor consumer-\", false), new ThreadPoolExecutor.AbortPolicy());\n DisruptorConsumer[] disruptorConsumers = new DisruptorConsumer[threads];\n for (int i = 0; i < threads; i++)\n {\n disruptorConsumers[i] = new DisruptorConsumer(disruptorService, executor);\n }\n //设置消费者Handler\n // 广播 消费者之间无依赖关系\n // disruptor.handleEventsWith(ArrayUtil.toArray(handlers, EventHandler.class));\n // 关闭 消费间有依赖关系,假设：2号需要在0号和1号处理完才能进行\n // disruptor.handleEventsWith(handlers.get(0),handlers.get(1)).then(handlers.get(2));\n // 分组 List workHandlers\n disruptor.handleEventsWithWorkerPool(disruptorConsumers);\n\n //设置异常处理\n disruptor.setDefaultExceptionHandler(new DisruptorExceptionHandler(disruptorService));\n\n ringBuffer = disruptor.start();\n this.isStart = true;\n }\n\n @Override\n public void onApplicationEvent(ContextRefreshedEvent contextRefreshedEvent) {\n log.info(\"Start disruptor..........\");\n doStart();\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/DisruptorThreadFactory.java",
"content": "package com.xiao.springcloud.demo.common.disruptor;\n\nimport java.util.concurrent.ThreadFactory;\nimport java.util.concurrent.atomic.AtomicLong;\n\n/**\n * [简要描述]:\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 14:49\n * @since JDK 1.8\n */\npublic class DisruptorThreadFactory implements ThreadFactory\n{\n private static final AtomicLong THREAD_NUMBER = new AtomicLong(1);\n\n private static final ThreadGroup THREAD_GROUP = new ThreadGroup(\"disruptor\");\n\n private static volatile boolean daemon;\n\n private final String namePrefix;\n\n private DisruptorThreadFactory(final String namePrefix, final boolean daemon)\n {\n this.namePrefix = namePrefix;\n DisruptorThreadFactory.daemon = daemon;\n }\n\n /**\n * Constructs a new {@code Thread}. Implementations may also initialize\n * priority, name, daemon status, {@code ThreadGroup}, etc.\n *\n * @param r a runnable to be executed by new thread instance\n * @return constructed thread, or {@code null} if the request to\n * create a thread is rejected\n */\n @Override\n public Thread newThread(Runnable r)\n {\n Thread thread = new Thread(THREAD_GROUP, r,\n THREAD_GROUP.getName() + \"-\" + namePrefix + \"-\" + THREAD_NUMBER.getAndIncrement());\n thread.setDaemon(daemon);\n if (thread.getPriority() != Thread.NORM_PRIORITY)\n {\n thread.setPriority(Thread.NORM_PRIORITY);\n }\n return thread;\n }\n\n /**\n * 自定义线程factory\n *\n * @param namePrefix\n * @param daemon\n * @return\n */\n public static ThreadFactory create(final String namePrefix, final boolean daemon)\n {\n return new DisruptorThreadFactory(namePrefix, daemon);\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/data/BasisData.java",
"content": "package com.xiao.springcloud.demo.common.disruptor.data;\n\nimport lombok.Getter;\nimport lombok.Setter;\n\n/**\n * [简要描述]: 数据基础类\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/6/4 08:54\n * @since JDK 1.8\n */\n@Setter\n@Getter\npublic class BasisData\n{\n /**\n * 事件名称\n */\n protected String event;\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/data/DataEvent.java",
"content": "package com.xiao.springcloud.demo.common.disruptor.data;\n\nimport lombok.Data;\n\n/**\n * [简要描述]: 定义事件\n * [详细描述]:通过 Disruptor 进行交换的数据类型\n *\n * @author llxiao\n * @version 1.0, 2019/3/21 15:12\n * @since JDK 1.8\n */\n@Data\npublic class DataEvent\n{\n /**\n * 具体数据\n */\n private BasisData basisData;\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/data/EventEnum.java",
"content": "package com.xiao.springcloud.demo.common.disruptor.data;\n\n/**\n * [简要描述]: 事件类型\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/6/4 08:43\n * @since JDK 1.8\n */\npublic enum EventEnum\n{\n /**\n * 日志事件\n */\n LOG_EVENT(\"log\");\n\n private String event;\n\n EventEnum(String event)\n {\n this.event = event;\n }\n\n public String getEvent()\n {\n return event;\n }\n }\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/event/ServiceEvent.java",
"content": "package com.xiao.springcloud.demo.common.disruptor.event;\n\nimport lombok.Getter;\nimport lombok.Setter;\nimport org.springframework.context.ApplicationEvent;\n\n/**\n * [简要描述]: Springboot 的Event数据事件\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/6/4 08:39\n * @since JDK 1.8\n */\n@Setter\n@Getter\npublic class ServiceEvent extends ApplicationEvent\n{\n /**\n * 事件类型\n */\n private String event;\n\n /**\n * Create a new ApplicationEvent.\n */\n public ServiceEvent(Object source, String event)\n {\n super(source);\n this.event = event;\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/readme.md",
"content": "1. Disruptor: 开源的并发框架,能够在无锁的情况下实现网络的Queue并发操作,其他更多[详情介绍](http://ifeve.com/disruptor/)\n2. 本common包封装的``Disruptor``与``Spring的Event``事件组合，实现业务在JVM内解耦。3.4.2 \n \n \n com.lmax \n disruptor \n ${disruptor.version} \n \n ```\n4. 启动disruptor:``的``onApplicationEvent(ServiceEvent serviceEvent)``方法{\n \n // 可以使用spring的异步实现@Async注解，需要配合启动类中添加 @EnableAsync注解 开启异步的支持\n @Async\n @Override\n public void onApplicationEvent(ServiceEvent event)\n {\n // 这个event事件名称要跟发送的时候事件名称一样的\n if (EventEnum.LOG_EVENT.getEvent().equals(event.getEvent()))\n {\n ServiceData serviceData = (ServiceData) event.getSource();\n // 进一步业务逻辑处理 todo\n }\n }\n }\n ```\n``严重警告：ringBufferSize的值设定需要保持理性的数量，环形队列是等着被替换而不是被回收，设置太大会撑爆你设定的JVM内存，最终导致OLD占满，接下来就是无限循环的FGC``\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/disruptor/service/DisruptorService.java",
"content": "package com.xiao.springcloud.demo.common.disruptor.service;\n\nimport com.xiao.springcloud.demo.common.disruptor.data.BasisData;\n\n/**\n * [简要描述]: 异步队列服务\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/25 09:50\n * @since JDK 1.8\n */\npublic interface DisruptorService\n{\n /**\n * [简要描述]:异步处理服务 numbers)\n {\n ForkjoinTask forkjoinTask = new ForkjoinTask(numbers, 0, numbers.size());\n Integer count = forkJoinPool.invoke(forkjoinTask);\n return count;\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/forkjoin/task/ForkjoinTask.java",
"content": "package com.xiao.springcloud.demo.common.forkjoin.task;\n\nimport java.util.List;\nimport java.util.concurrent.CopyOnWriteArrayList;\nimport java.util.concurrent.RecursiveTask;\n\n/**\n * [简要描述]: fork join demo操作\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/6/11 19:55\n * @since JDK 1.8\n */\npublic class ForkjoinTask extends RecursiveTask\n{\n /**\n * 待处理的平台商品数据\n */\n private CopyOnWriteArrayList arrayList;\n\n /**\n * 拆分条件\n */\n private static int THRESHOLD = 500;\n\n private int start;\n private int end;\n\n public ForkjoinTask(List arrayList, int start, int end)\n {\n this.arrayList = new CopyOnWriteArrayList<>(arrayList);\n this.start = start;\n this.end = end;\n }\n\n /**\n * The main computation performed by this task.\n *\n * @return the result of the computation\n */\n @Override\n protected Integer compute()\n {\n if (end - start <= THRESHOLD)\n {\n return add(arrayList);\n }\n else\n {\n int middle = (end + start) / 2;\n List arrayList1 = arrayList.subList(start, middle);\n List arrayList2 = arrayList.subList(middle, end);\n ForkjoinTask forkjoinTask1 = new ForkjoinTask(arrayList1, 0, arrayList1.size());\n ForkjoinTask forkjoinTask2 = new ForkjoinTask(arrayList2, 0, arrayList2.size());\n invokeAll(forkjoinTask1, forkjoinTask2);\n return forkjoinTask1.join() + forkjoinTask2.join();\n }\n }\n\n private Integer add(CopyOnWriteArrayList arrayList)\n {\n int status = 0;\n for (Integer integer : arrayList)\n {\n status += integer;\n }\n return status;\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/README.md",
"content": "springcloud fegin内部交互异常统一处理\n\n原理：\n1. 服务端抛出统一异常，由DefaultControllerAdvice方法捕捉封装，期需要将http response的响应头设置为500\n2. 客户端自定义解码器，对异常进行解码，由CommonFeignErrorDecoder进行对异常处理\n\n\n服务端客户端交互部分对象传输为空：\n 自定义httpmessageconvert，由FastjsonConfig类处理，添加fastjson转换"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/advice/DefaultControllerAdvice.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.advice;\n\nimport com.fasterxml.jackson.databind.ObjectMapper;\nimport com.netflix.hystrix.exception.HystrixRuntimeException;\nimport com.xiao.springcloud.demo.common.exception.CommonException;\nimport com.xiao.springcloud.demo.common.exception.CommonExceptionEnum;\nimport com.xiao.springcloud.demo.common.gloab.response.ErrorResponseData;\nimport com.xiao.springcloud.demo.common.gloab.response.ResponseData;\nimport feign.RetryableException;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.http.HttpStatus;\nimport org.springframework.web.bind.annotation.ControllerAdvice;\nimport org.springframework.web.bind.annotation.ExceptionHandler;\nimport org.springframework.web.bind.annotation.ResponseBody;\nimport org.springframework.web.bind.annotation.ResponseStatus;\n\nimport javax.servlet.http.HttpServletResponse;\n\n/**\n * 全局的的异常拦截器（拦截所有的控制器）\n * （带有@RequestMapping注解的方法上都会拦截）\n *\n * @author zhdong\n */\n@Slf4j\n@ControllerAdvice\npublic class DefaultControllerAdvice\n{\n\n @Autowired\n private ObjectMapper objectMapper;\n\n /**\n * 拦截common异常\n */\n @ExceptionHandler(CommonException.class)\n @ResponseStatus(HttpStatus.INTERNAL_SERVER_ERROR)\n @ResponseBody\n public ResponseData serviceException(CommonException e)\n {\n log.error(\"系统异常:\", e);\n return new ErrorResponseData(e.getCode(), e.getErrorMessage());\n }\n\n /**\n * 拦截common异常\n */\n @ExceptionHandler(HystrixRuntimeException.class)\n @ResponseStatus(HttpStatus.INTERNAL_SERVER_ERROR)\n @ResponseBody\n public ResponseData hystrixRuntimeException(HystrixRuntimeException e)\n {\n log.error(\"系统异常:\", e);\n Throwable cause = e.getCause();\n //return new ErrorResponseData(e.getCode(), e.getErrorMessage());\n if (cause instanceof CommonException)\n {\n return serviceException((CommonException) cause);\n }\n cause = e.getFallbackException();\n if (null != cause)\n {\n log.error(\"服务调用熔断异常：\", cause);\n // 解决服务之间调用，自定义熔断内抛出的异常处理\n if (null != cause.getCause())\n {\n Throwable e1 = cause.getCause().getCause();\n if (null != e1 && e1 instanceof CommonException)\n {\n return serviceException((CommonException) e1);\n }\n }\n }\n return new ErrorResponseData(CommonExceptionEnum.REMOTE_SERVICE_NULL\n .getCode(), CommonExceptionEnum.REMOTE_SERVICE_NULL.getMessage());\n }\n\n /**\n * 拦截RetryableException异常\n */\n @ExceptionHandler(RetryableException.class)\n @ResponseStatus(HttpStatus.INTERNAL_SERVER_ERROR)\n @ResponseBody\n public ResponseData retryableException(RetryableException e)\n {\n log.error(\"系统异常:\", e);\n return new ErrorResponseData(CommonExceptionEnum.REMOTE_SERVICE_TIMEOUT\n .getCode(), CommonExceptionEnum.REMOTE_SERVICE_TIMEOUT.getMessage());\n }\n\n /**\n * 拦截未知的运行时异常\n */\n @ExceptionHandler(Exception.class)\n @ResponseBody\n public ResponseData notFount(Exception e, HttpServletResponse reponse)\n {\n if (HttpStatus.NOT_FOUND.value() == reponse.getStatus())\n {\n log.error(CommonExceptionEnum.NO_FOUNT.getMessage(), e);\n return new ErrorResponseData(CommonExceptionEnum.NO_FOUNT.getCode(), CommonExceptionEnum.NO_FOUNT\n .getMessage());\n }\n log.error(CommonExceptionEnum.SYSTEM_ERROR.getMessage(), e);\n // 设置httpresponse头为500信息\n reponse.setStatus(HttpStatus.INTERNAL_SERVER_ERROR.value());\n return new ErrorResponseData(CommonExceptionEnum.SYSTEM_ERROR.getCode(), CommonExceptionEnum.SYSTEM_ERROR\n .getMessage());\n }\n\n //\t@Override\n //\tpublic boolean supports(MethodParameter methodParameter, Class aClass) {\n //\t\treturn true;\n //\t}\n //\n //\t/**\n //\t * 封装返回结果\n //\t * @param returnValue\n //\t * @param methodParameter\n //\t * @param mediaType\n //\t * @param aClass\n //\t * @param serverHttpRequest\n //\t * @param serverHttpResponse\n //\t * @return\n //\t */\n //\t@Override\n //\tpublic Object beforeBodyWrite(Object returnValue, MethodParameter methodParameter, MediaType mediaType, Class aClass, ServerHttpRequest serverHttpRequest, ServerHttpResponse serverHttpResponse) {\n //\n //\t\t//如果已经是ResponseData，直接返回\n //\t\tif ( returnValue instanceof ResponseData) {\n //\t\t\treturn returnValue;\n //\t\t}\n //\t\telse if ( returnValue instanceof String ){\n //\t\t\ttry {\n //\t\t\t\treturn objectMapper.writeValueAsString(SuccessResponseData.success(returnValue));\n //\t\t\t}catch (Exception e){\n //\t\t\t\tlog.error(\"返回结果转换json异常\",e);\n //\t\t\t\treturn ErrorResponseData.error(\"返回结果转换json异常\");\n //\t\t\t}\n //\t\t}\n //\n //\t\treturn SuccessResponseData.success(returnValue);\n //\t}\n\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/config/FastjsonConfig.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.config;\n\nimport com.alibaba.fastjson.parser.ParserConfig;\nimport com.alibaba.fastjson.serializer.SerializerFeature;\nimport com.alibaba.fastjson.support.config.FastJsonConfig;\nimport com.alibaba.fastjson.support.spring.FastJsonHttpMessageConverter;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnClass;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnMissingBean;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnWebApplication;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\nimport org.springframework.http.MediaType;\n\nimport java.nio.charset.Charset;\nimport java.util.ArrayList;\nimport java.util.List;\n\n/**\n * fastjson配置类\n *\n * @author zhdong\n */\n@Configuration(\"defaultFastjsonConfig\")\n@ConditionalOnClass(com.alibaba.fastjson.JSON.class)\n@ConditionalOnMissingBean(FastJsonHttpMessageConverter.class)\n@ConditionalOnWebApplication\npublic class FastjsonConfig\n{\n\n @Bean\n public FastJsonHttpMessageConverter fastJsonHttpMessageConverter()\n {\n FastJsonHttpMessageConverter converter = new FastJsonHttpMessageConverter();\n converter.setFastJsonConfig(fastjsonConfig());\n converter.setSupportedMediaTypes(getSupportedMediaType());\n ParserConfig.getGlobalInstance().setAutoTypeSupport(true);\n return converter;\n }\n\n /**\n * fastjson的配置\n */\n public FastJsonConfig fastjsonConfig()\n {\n FastJsonConfig fastJsonConfig = new FastJsonConfig();\n fastJsonConfig.setSerializerFeatures(\n //SerializerFeature.PrettyFormat, //格式化输出 ，仅限调试使用\n SerializerFeature.WriteMapNullValue, //是否输出值为null的字段,默认为false\n SerializerFeature.DisableCircularReferenceDetect, //消除循环引用\n SerializerFeature.WriteNullListAsEmpty //List字段如果为null,输出为[],而非null\n );\n fastJsonConfig.setDateFormat(\"yyyy-MM-dd HH:mm:ss\");\n fastJsonConfig.setCharset(Charset.forName(\"utf-8\"));\n //不需要将null转换为空字符\n// ValueFilter valueFilter = (object, name, value) -> {\n// return null == value ? \"\" : value;\n// };\n// fastJsonConfig.setSerializeFilters(valueFilter);\n return fastJsonConfig;\n }\n\n /**\n * 支持的mediaType类型\n */\n public List getSupportedMediaType()\n {\n ArrayList mediaTypes = new ArrayList<>();\n\n mediaTypes.add(MediaType.APPLICATION_JSON);\n mediaTypes.add(MediaType.APPLICATION_JSON_UTF8);\n mediaTypes.add(MediaType.APPLICATION_ATOM_XML);\n mediaTypes.add(MediaType.APPLICATION_FORM_URLENCODED);\n mediaTypes.add(MediaType.APPLICATION_OCTET_STREAM);\n mediaTypes.add(MediaType.APPLICATION_PDF);\n mediaTypes.add(MediaType.APPLICATION_RSS_XML);\n mediaTypes.add(MediaType.APPLICATION_XHTML_XML);\n mediaTypes.add(MediaType.APPLICATION_XML);\n mediaTypes.add(MediaType.IMAGE_GIF);\n mediaTypes.add(MediaType.IMAGE_JPEG);\n mediaTypes.add(MediaType.IMAGE_PNG);\n mediaTypes.add(MediaType.TEXT_EVENT_STREAM);\n mediaTypes.add(MediaType.TEXT_HTML);\n mediaTypes.add(MediaType.TEXT_MARKDOWN);\n mediaTypes.add(MediaType.TEXT_PLAIN);\n mediaTypes.add(MediaType.TEXT_XML);\n\n //增加解析spring boot actuator结果的解析\n mediaTypes.add(MediaType.valueOf(\"application/vnd.spring-boot.actuator.v2+json\"));\n\n return mediaTypes;\n }\n\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/config/FeignConfig.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.config;\n\nimport com.xiao.springcloud.demo.common.gloab.interceptor.fegin.CommonFeignErrorDecoder;\nimport com.xiao.springcloud.demo.common.gloab.interceptor.fegin.CommonFeignHeaderProcessInterceptor;\nimport com.xiao.springcloud.demo.common.gloab.interceptor.fegin.DefaultCommonErrorAttributes;\nimport feign.RequestInterceptor;\nimport feign.codec.ErrorDecoder;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\n\n/**\n * feign的错误编码配置（为了feign接收到错误的返回，转化成roses可识别的ServiceException）\n *\n * @author zhdong\n * @Date 2018/8/30 11:11\n */\n@Configuration\npublic class FeignConfig {\n\n /**\n * roses自定义错误解码器\n */\n // @Bean\n // @Scope(\"prototype\")\n // public Feign.Builder feignHystrixBuilder() {\n // return HystrixFeign.builder().errorDecoder(new CommonFeignErrorDecoder());\n // }\n @Bean\n public ErrorDecoder errorDecoder(){\n return new CommonFeignErrorDecoder();\n }\n\n /**\n * feign请求加上当前请求接口的headers\n */\n @Bean\n public RequestInterceptor requestInterceptor() {\n return new CommonFeignHeaderProcessInterceptor();\n }\n\n /**\n * 覆盖spring默认的响应消息格式\n */\n @Bean\n public DefaultCommonErrorAttributes defaultRosesErrorAttributes() {\n return new DefaultCommonErrorAttributes();\n }\n\n}"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/fegin/CommonFeignErrorDecoder.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.fegin;\n\nimport cn.hutool.core.io.IoUtil;\nimport com.alibaba.fastjson.JSON;\nimport com.alibaba.fastjson.JSONObject;\nimport com.xiao.springcloud.demo.common.exception.CommonException;\nimport com.xiao.springcloud.demo.common.exception.CommonExceptionEnum;\nimport feign.Response;\nimport feign.codec.ErrorDecoder;\nimport lombok.extern.slf4j.Slf4j;\n\nimport java.io.IOException;\n\n/**\n * 错误解码器\n *\n * @author zhdong\n */\n@Slf4j\npublic class CommonFeignErrorDecoder implements ErrorDecoder\n{\n\n @Override\n public Exception decode(String methodKey, Response response)\n {\n log.error(\"调用服务返回Response:\" + response);\n String responseBody;\n try\n {\n if (response == null || response.body() == null)\n {\n log.error(\"未得到服务端的响应结果...\");\n if (response != null && response.status() == 404)\n {\n return new CommonException(CommonExceptionEnum.REMOTE_SERVICE_NULL);\n }\n else\n {\n return new CommonException(CommonExceptionEnum.SERVICE_ERROR);\n }\n }\n responseBody = IoUtil.read(response.body().asInputStream(), \"UTF-8\");\n }\n catch (IOException e)\n {\n log.error(\"读取Response响应io错误\", e);\n return new CommonException(CommonExceptionEnum.IO_ERROR);\n }\n\n log.error(\"服务提供方返回异常结果为：\" + responseBody);\n JSONObject parse = JSON.parseObject(responseBody);\n Integer code = parse.getInteger(\"code\");\n String message = parse.getString(\"message\");\n if (message == null)\n {\n message = CommonExceptionEnum.SERVICE_ERROR.getMessage();\n }\n if (code == null)\n {\n //status为spring默认返回的数据\n Integer status = parse.getInteger(\"status\");\n\n if (status == null)\n {\n return new CommonException(CommonExceptionEnum.SERVICE_ERROR.getCode(), message);\n }\n else\n {\n return new CommonException(status, message);\n }\n }\n else\n {\n return new CommonException(code, message);\n }\n }\n}"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/fegin/CommonFeignHeaderProcessInterceptor.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.fegin;\n\nimport feign.RequestInterceptor;\nimport feign.RequestTemplate;\n\nimport javax.servlet.http.HttpServletRequest;\nimport java.util.Enumeration;\n\n/**\n * feign远程调用添加header的过滤器\n *\n * @author zhdong\n */\npublic class CommonFeignHeaderProcessInterceptor implements RequestInterceptor\n{\n\n @Override\n public void apply(RequestTemplate requestTemplate)\n {\n\n //当前feign远程调用环境不是由http接口发起，例如test单元测试中的feign调用或者项目启动后的feign调用\n HttpServletRequest request = null;\n\n try\n {\n request = HttpContext.getRequest();\n }\n catch (NullPointerException e)\n {\n\n //被调环境中不存在request对象，则不往header里添加当前请求环境的header\n return;\n }\n if (request != null)\n {\n Enumeration headerNames = request.getHeaderNames();\n if (headerNames != null)\n {\n while (headerNames.hasMoreElements())\n {\n String name = headerNames.nextElement();\n String values = request.getHeader(name);\n requestTemplate.header(name, values);\n }\n }\n }\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/fegin/DefaultCommonErrorAttributes.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.fegin;\n\nimport cn.hutool.core.bean.BeanUtil;\nimport com.xiao.springcloud.demo.common.exception.CommonExceptionEnum;\nimport com.xiao.springcloud.demo.common.gloab.response.ResponseData;\nimport org.springframework.boot.autoconfigure.web.DefaultErrorAttributes;\nimport org.springframework.web.context.request.RequestAttributes;\n\nimport java.util.Map;\n\n/**\n * 重写spring得默认响应提示信息\n *\n * @author zhdong\n * @Date 2018/8/30 23:14\n */\npublic class DefaultCommonErrorAttributes extends DefaultErrorAttributes\n{\n\n @Override\n public Map getErrorAttributes(RequestAttributes requestAttributes, boolean includeStackTrace) {\n return BeanUtil.beanToMap(ResponseData.error(CommonExceptionEnum.SERVICE_ERROR.getMessage()));\n\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/fegin/FeignBeanFactoryPostProcessor.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.fegin;\n\nimport org.springframework.beans.BeansException;\nimport org.springframework.beans.factory.config.BeanDefinition;\nimport org.springframework.beans.factory.config.BeanFactoryPostProcessor;\nimport org.springframework.beans.factory.config.ConfigurableListableBeanFactory;\nimport org.springframework.stereotype.Component;\n\nimport java.util.Arrays;\n\n/**\n * [简要描述]: 解决junit测试完毕销毁FeignContext 异常问题\n * [详细描述]: 异常信息：BeanCreationNotAllowedException: Error creating bean with name 'eurekaAutoServic'....\n * git 参考地址：https://github.com/spring-cloud/spring-cloud-netflix/issues/1952\n *\n * @author llxiao\n * @version 1.0, 2018/9/11 15:19\n * @since JDK 1.8\n */\n@Component\npublic class FeignBeanFactoryPostProcessor implements BeanFactoryPostProcessor\n{\n @Override\n public void postProcessBeanFactory(ConfigurableListableBeanFactory beanFactory) throws BeansException\n {\n if (containsBeanDefinition(beanFactory, \"feignContext\", \"eurekaAutoServiceRegistration\"))\n {\n BeanDefinition bd = beanFactory.getBeanDefinition(\"feignContext\");\n bd.setDependsOn(\"eurekaAutoServiceRegistration\");\n }\n }\n\n private boolean containsBeanDefinition(ConfigurableListableBeanFactory beanFactory, String... beans)\n {\n return Arrays.stream(beans).allMatch(b -> beanFactory.containsBeanDefinition(b));\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/interceptor/fegin/HttpContext.java",
"content": "package com.xiao.springcloud.demo.common.gloab.interceptor.fegin;\n\nimport org.springframework.web.context.request.RequestContextHolder;\nimport org.springframework.web.context.request.ServletRequestAttributes;\n\nimport javax.servlet.http.HttpServletRequest;\nimport javax.servlet.http.HttpServletResponse;\n\n/**\n * 快捷获取HttpServletRequest,HttpServletResponse\n *\n * @author zhdong\n */\npublic class HttpContext\n{\n\n public static String getIp()\n {\n return HttpContext.getRequest().getRemoteHost();\n }\n\n public static HttpServletResponse getResponse() throws NullPointerException\n {\n return ((ServletRequestAttributes) RequestContextHolder.getRequestAttributes()).getResponse();\n }\n\n public static HttpServletRequest getRequest() throws NullPointerException\n {\n HttpServletRequest request = ((ServletRequestAttributes) RequestContextHolder.getRequestAttributes())\n .getRequest();\n return request;\n }\n\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/response/ErrorResponseData.java",
"content": "package com.xiao.springcloud.demo.common.gloab.response;\n\n\n/**\n * 请求失败的返回\n *\n * @author zhdong\n * @Date 2018/8/1\n */\npublic class ErrorResponseData extends ResponseData {\n\n public ErrorResponseData() {\n }\n\n public ErrorResponseData(String message) {\n super(false, DEFAULT_ERROR_CODE, message, null);\n }\n\n public ErrorResponseData(Integer code, String message) {\n super(false, code, message, null);\n }\n\n public ErrorResponseData(Integer code, String message, Object object) {\n super(false, code, message, object);\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/response/ResponseData.java",
"content": "package com.xiao.springcloud.demo.common.gloab.response;\n\n\nimport java.io.Serializable;\n\n/**\n * 返回给前台的通用包装\n *\n * @author zhdong\n * @Date 2018/8/1\n */\npublic class ResponseData implements Serializable {\n\n public static final String DEFAULT_SUCCESS_MESSAGE = \"请求成功\";\n\n public static final String DEFAULT_ERROR_MESSAGE = \"网络异常\";\n\n public static final Integer DEFAULT_SUCCESS_CODE = 200;\n\n public static final Integer DEFAULT_ERROR_CODE = 500;\n\n /**\n * 请求是否成功\n */\n private Boolean success;\n\n /**\n * 响应状态码\n */\n private Integer code;\n\n /**\n * 响应信息\n */\n private String message;\n\n /**\n * 响应对象\n */\n private Object data;\n\n public ResponseData() {\n }\n\n public ResponseData(Boolean success, Integer code, String message, Object data) {\n this.success = success;\n this.code = code;\n this.message = message;\n this.data = data;\n }\n\n public Boolean getSuccess() {\n return success;\n }\n\n public void setSuccess(Boolean success) {\n this.success = success;\n }\n\n public String getMessage() {\n return message;\n }\n\n public void setMessage(String message) {\n this.message = message;\n }\n\n public Object getData() {\n return data;\n }\n\n public void setData(Object data) {\n this.data = data;\n }\n\n public Integer getCode() {\n return code;\n }\n\n public void setCode(Integer code) {\n this.code = code;\n }\n\n public static SuccessResponseData success() {\n return new SuccessResponseData(null);\n }\n\n public static SuccessResponseData success(Object data) {\n return new SuccessResponseData(data);\n }\n\n public static SuccessResponseData success(Integer code, String message, Object data) {\n return new SuccessResponseData(code, message, data);\n }\n\n public static ErrorResponseData error(String message) {\n return new ErrorResponseData(message);\n }\n\n public static ErrorResponseData error(Integer code, String message) {\n return new ErrorResponseData(code, message);\n }\n\n public static ErrorResponseData error(Integer code, String message, Object object) {\n return new ErrorResponseData(code, message, object);\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/gloab/response/SuccessResponseData.java",
"content": "package com.xiao.springcloud.demo.common.gloab.response;\n\n/**\n * 请求成功的返回\n *\n * @author zhdong\n * @Date 2018/8/1\n */\npublic class SuccessResponseData extends ResponseData {\n\n public SuccessResponseData() {\n }\n\n public SuccessResponseData(Object object) {\n super(true, DEFAULT_SUCCESS_CODE, DEFAULT_SUCCESS_MESSAGE, object);\n }\n\n public SuccessResponseData(Integer code, String message, Object object) {\n super(true, code, message, object);\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/logaspect/LogAnnotation.java",
"content": "package com.xiao.springcloud.demo.common.logaspect;\n\nimport java.lang.annotation.*;\n\nimport static java.lang.annotation.RetentionPolicy.RUNTIME;\n\n/**\n * [简要描述]: 自定义日志注解 header = this.assembleHeader(request);\n String clientSign = String.valueOf(header.get(SignConstants.SIGN_NAME));\n if (StringUtils.isBlank(clientSign))\n {\n log.error(\"请求服务器URL:{}缺少签名参数!\", uri);\n throw new CommonException(1002, \"缺少签名参数\");\n }\n String appId = String.valueOf(header.get(SignConstants.APP_ID));\n\n if (StringUtils.isBlank(appId))\n {\n log.error(\"请求服务器URL:{}缺少AppId参数!\", uri);\n throw new CommonException(1002, \"缺少appid参数!\");\n }\n\n // 暂时保留\n ///Long timestamp = (Long) header.get(TIMESTAMP);\n\n if (appManagerService.exist(appId))\n {\n String serverSign = (String) request.getAttribute(SignConstants.SEVER_SIGN);\n if (!clientSign.equals(serverSign))\n {\n log.error(\"Appid:{} 请求服务器URL: {}，请求签名错误!\", appId, uri);\n log.error(\"客户端签名：{}，服务端签名：{}\", clientSign, serverSign);\n throw new CommonException(1000, \"签名错误!\");\n }\n }\n else\n {\n log.error(\"请求服务器URL:{},App ID: {}非法请求\", uri, appId);\n throw new CommonException(1001, \"请求非法，无appid\");\n }\n return joinPoint.proceed(args);\n }\n else\n {\n // 不需要签名校验，放行\n return joinPoint.proceed(args);\n }\n\n }\n\n private Map assembleHeader(HttpServletRequest request)\n {\n Map header = new HashMap<>(16);\n Enumeration enumeration = request.getHeaderNames();\n while (enumeration.hasMoreElements())\n {\n String name = enumeration.nextElement();\n String value = request.getHeader(name);\n header.put(name, value);\n }\n return header;\n }\n}"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/sign/filter/WrapperRequestFilter.java",
"content": "package com.xiao.springcloud.demo.common.sign.filter;\n\nimport com.xiao.springcloud.demo.common.sign.SignConstants;\nimport com.xiao.springcloud.demo.common.sign.request.BodyReaderHttpServletRequestWrapper;\nimport com.xiao.springcloud.demo.common.sign.service.AppManagerService;\nimport com.xiao.springcloud.demo.common.sign.util.HttpRequestUtils;\nimport com.xiao.springcloud.demo.common.sign.util.SignUtil;\nimport lombok.extern.slf4j.Slf4j;\nimport org.apache.commons.lang3.StringUtils;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.core.annotation.Order;\nimport org.springframework.stereotype.Component;\n\nimport javax.servlet.*;\nimport javax.servlet.http.HttpServletRequest;\nimport java.io.IOException;\n\n/**\n * [简要描述]: 包装reqeust使用\n * [详细描述]:\n *\n * @author xiaolinlin\n * @version 1.0, 2020/2/21 16:49\n * @since JDK 1.8\n */\n@Component\n@Slf4j\n@Order(1)\npublic class WrapperRequestFilter implements Filter\n{\n @Autowired\n private AppManagerService appManagerService;\n\n /**\n * Called by the web container to indicate to a filter that it is being\n * placed into service. The servlet container calls the init method exactly\n * once after instantiating the filter. The init method must complete\n * successfully before the filter is asked to do any filtering work.\n * \n * The web container cannot place the filter into service if the init method\n * either:\n *
\n * Throws a ServletException \n * Does not return within a time period defined by the web\n * container \n * \n *\n * @param filterConfig The configuration information associated with the\n * filter instance being initialised\n * @exception ServletException if the initialisation fails\n */\n @Override\n public void init(FilterConfig filterConfig) throws ServletException\n {\n\n }\n\n /**\n * The doFilter method of the Filter is called by the container\n * each time a request/response pair is passed through the chain due to a\n * client request for a resource at the end of the chain. The FilterChain\n * passed in to this method allows the Filter to pass on the request and\n * response to the next entity in the chain.\n * \n * A typical implementation of this method would follow the following\n * pattern:- Either invoke the next entity in the chain using\n * the FilterChain object (chain.doFilter()), or not pass on the request/response pair to the\n * next entity in the filter chain to block the request processing
\n * This method gives the filter an opportunity to clean up any resources\n * that are being held (for example, memory, file handles, threads) and make\n * sure that any persistent state is synchronized with the filter's current\n * state in memory.\n */\n @Override\n public void destroy()\n {\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/sign/readme.md",
"content": "提供生成签名串工具类 kvParams, String key)\nSignUtil.generateSign(Map kvParams, String jsonParams, String key)\nSignUtil.generateSignByJson(String jsonParams,String key)\nSignUtil.generateSign(String content,String key)\n```\n签名说明:\n1. KV参数拼接\n2. JSON请求参数，内部会做JSONObject转换，转成json字符串\n3. 将kv参数和json参数拼在一起，按ascii排序规则进行排序\n4. 对排序后的字符串做HmacSHA1加密\n\nSpringboot web应用签名： appInfoMap = new ConcurrentHashMap<>();\n\n /**\n * appInfo配置实现This method allows the bean instance to perform initialization only\n * possible when all bean properties have been set and to throw an\n * exception in the event of misconfiguration.\n *\n * @exception Exception in the event of misconfiguration (such\n * as failure to set an essential property) or if initialization fails.\n */\n @Override\n public void afterPropertiesSet() throws Exception\n {\n if (StringUtils.isNotBlank(appInfo))\n {\n // 初始化appiId KV配置\n String[] appInfos = appInfo.split(\",\");\n for (String app : appInfos)\n {\n String[] appKv = app.split(\":\");\n if (appKv.length == 2)\n {\n appInfoMap.put(appKv[0], appKv[1]);\n }\n }\n }\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/sign/util/AsciiSortUtil.java",
"content": "package com.xiao.springcloud.demo.common.sign.util;\n\nimport org.apache.commons.lang3.StringUtils;\n\n/**\n * [简要描述]: ascii码排序工具\n * [详细描述]:\n *\n * @author xiaolinlin\n * @version 1.0, 2020/2/21 10:56\n * @since JDK 1.8\n */\npublic class AsciiSortUtil\n{\n /**\n * [简要描述]:对String进行ASCII码排序 parameterNames = request.getParameterNames();\n while (parameterNames.hasMoreElements())\n {\n String pName = parameterNames.nextElement();\n String pValue = request.getParameter(pName);\n sb.append(pName);\n sb.append(pValue);\n }\n return sb.toString();\n }\n\n /**\n * [简要描述]:获取JSON消息体参数 kvParams, String key)\n {\n if (MapUtils.isNotEmpty(kvParams) && StringUtils.isNotBlank(key))\n {\n StringBuilder paramSb = new StringBuilder();\n kvParams.forEach((k, v) -> paramSb.append(k + v));\n return generateSign(paramSb.toString(), key);\n }\n return \"\";\n }\n\n /**\n * [简要描述]:JSON和键值对参数合并 kvParams, String jsonParams, String key)\n {\n if (StringUtils.isNotBlank(key))\n {\n StringBuilder paramSb = new StringBuilder();\n if (MapUtils.isNotEmpty(kvParams))\n {\n kvParams.forEach((k, v) -> paramSb.append(k + v));\n }\n if (StringUtils.isNotBlank(jsonParams))\n {\n try\n {\n final JSONObject jsonObject = JSONObject.parseObject(jsonParams);\n paramSb.append(jsonObject.toJSONString());\n }\n catch (JSONException e)\n {\n logger.error(\"生成签名串的JSON请求参数错误，不能转成JSON格式!\", e);\n }\n }\n return generateSign(paramSb.toString(), key);\n }\n\n return \"\";\n }\n\n /**\n * [简要描述]:json参数处理 kvParmas = new HashMap<>();\n kvParmas.put(\"productName\", \"test11111\");\n String key = \"abcdefg111\";\n System.out.println(generateSign(kvParmas, key));\n System.out.println(generateSign(kvParmas, json, key));\n System.out.println(generateSignByJson(json, key));\n }\n\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/util/CodeFormatConstants.java",
"content": "/*\n * Smile Software Technologies Co., Ltd. Copyright 2015-2017, All rights reserved.\n * 文件名 :CodeForamtConstants.java\n * 创建人 :xiaolinlin\n * 创建时间:2017年2月21日\n */\n\npackage com.xiao.springcloud.demo.common.util;\n\n/**\n * [简要描述]:常用编码格式常量池\n{\n private CopyOnWriteArrayList list;\n private int pageSize = 0;\n private int pageCount = 0;\n private int listSize = 0;\n private int index = 0;\n\n /**\n * [简要描述]:List分页工具初始化 list, int pageSize)\n {\n if (null == list || 0 == list.size())\n {\n throw new UnsupportedOperationException(\"List can not null!\");\n }\n\n if (0 == pageSize)\n {\n throw new UnsupportedOperationException(\"Page size can not 0\");\n }\n\n this.list = new CopyOnWriteArrayList<>(list);\n this.listSize = list.size();\n\n if (pageSize > listSize)\n {\n this.pageSize = listSize;\n }\n else\n {\n this.pageSize = pageSize;\n }\n\n this.pageCount = listSize / pageSize;\n this.pageCount = listSize % pageSize == 0 ? pageCount : pageCount + 1;\n this.index = 0;\n }\n\n /**\n * [简要描述]:获取首页\n * xiaolinlin 2020/1/15 - 10:02\n **/\n public List getFistPage()\n {\n return list.subList(0, pageSize);\n }\n\n /**\n * [简要描述]:获取最后一页\n * xiaolinlin 2020/1/15 - 10:03\n **/\n public List getLastPage()\n {\n return list.subList((pageCount - 1) * pageSize, listSize);\n }\n\n /**\n * [简要描述]:获取下一页\n * xiaolinlin 2020/1/15 - 10:03\n **/\n public List nextPage()\n {\n List subList = null;\n if (index == pageCount - 1)\n {\n subList = list.subList(index * pageSize, listSize);\n }\n else\n {\n subList = list.subList(index * pageSize, (index + 1) * pageSize);\n }\n index++;\n return subList;\n }\n\n /**\n * [简要描述]:是否有下一页 list = new ArrayList<>();\n int length = 23;\n for (int i = 0; i < length; i++)\n {\n list.add(i);\n }\n int pageSize = 30;\n System.out.println(list);\n\n ListPageUtil listPageUtil = new ListPageUtil<>(list, pageSize);\n System.out.println(\"List size: \" + listPageUtil.getListSize());\n System.out.println(\"Page count: \" + listPageUtil.getPageCount());\n System.out.println(\"Page size: \" + listPageUtil.getPageSize());\n System.out.println(\"First page: \" + listPageUtil.getFistPage());\n System.out.println(\"Last page: \" + listPageUtil.getLastPage());\n while (listPageUtil.hasNext())\n {\n System.out.println(\"Page index: \" + listPageUtil.getIndex());\n System.out.println(\"Next page: \" + listPageUtil.nextPage());\n }\n\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/util/StringLengthUtils.java",
"content": "package com.xiao.springcloud.demo.common.util;\n\nimport lombok.extern.slf4j.Slf4j;\nimport org.apache.commons.lang3.StringUtils;\n\nimport java.io.UnsupportedEncodingException;\n\n/**\n * [简要描述]: 字符串长度计算\n * [详细描述]:\n *\n * @author xiaolinlin\n * @version 1.0, 2020/1/14 15:50\n * @since JDK 1.8\n */\n@Slf4j\npublic class StringLengthUtils\n{\n private static final int UNICODE_LENGTH = 3;\n\n private static final int GBK_LENGTH = 2;\n\n private static final String GBK = \"GBK\";\n\n private static final String UTF_8 = \"UTF-8\";\n\n /**\n * [简要描述]:获取字符长度\n * 原本用于编码的检错和纠错的一个算法\n * 现在拿来计算相似度，如果差异值小于一定阈值则相似，一般经验值小于5为同一张图片\n *\n * @param str1\n * @param str2\n * @return 距离\n */\n private static long getHammingDistance(String str1, String str2)\n {\n int distance;\n if (str1 == null || str2 == null || str1.length() != str2.length())\n {\n distance = -1;\n }\n else\n {\n distance = 0;\n for (int i = 0; i < str1.length(); i++)\n {\n if (str1.charAt(i) != str2.charAt(i))\n {\n distance++;\n }\n }\n }\n return distance;\n }\n\n //DHashUtil 参数值为待处理文件夹\n public static void main(String[] args)\n {\n File image0 = new File(\"D:/image/4200014361-000/_m_01.jpg\");\n File image1 = new File(\"D:/image/4200014361-000/_m_01-1.jpg\");\n File image2 = new File(\"D:/image/4200014361-000/_m_02.jpg\");\n\n System.out.println(\"图片1hash值：\" + getDHash(image0));\n System.out.println(\"图片2hash值：\" + getDHash(image1));\n System.out.println(\"图片3hash值：\" + getDHash(image2));\n System.out.println(\"图1-2海明距离为：\" + getHammingDistance(getDHash(image0), getDHash(image1)));\n System.out.println(\"图2-3海明距离为：\" + getHammingDistance(getDHash(image1), getDHash(image2)));\n\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/util/image/ImagePHashUtil.java",
"content": "package com.xiao.springcloud.demo.common.util.image;\n\nimport lombok.extern.slf4j.Slf4j;\nimport org.apache.commons.lang3.StringUtils;\n\nimport javax.imageio.ImageIO;\nimport java.awt.*;\nimport java.awt.color.ColorSpace;\nimport java.awt.image.BufferedImage;\nimport java.awt.image.ColorConvertOp;\nimport java.io.FileInputStream;\nimport java.io.InputStream;\nimport java.net.URL;\n\n/**\n * [简要描述]: 基于感知哈希算法的pHash图像配准算法\n * [详细描述]:\n * pHash的工作过程如下\n * （1）缩小尺寸：pHash以小图片开始，但图片大于8*8，32*32是最好的。这样做的目的是简化了DCT的计算，而不是减小频率。\n * （2）简化色彩：将图片转化成灰度图像，进一步简化计算量。\n * （3）计算DCT：计算图片的DCT变换，得到32*32的DCT系数矩阵。\n * （4）缩小DCT：虽然DCT的结果是32*32大小的矩阵，但我们只要保留左上角的8*8的矩阵，这部分呈现了图片中的最低频率。\n * （5）计算平均值：如同均值哈希一样，计算DCT的均值。\n * （6）计算hash值：这是最主要的一步，根据8*8的DCT矩阵，设置0或1的64位的hash值，大于等于DCT均值的设为”1”，小于DCT均值的设为“0”。组合在一起，就构成了一个64位的整数，这就是这张图片的指纹。\n * ————————————————\n * 版权声明：本文为CSDN博主「No Silver Bullet」的原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接及本声明。\n * 原文链接：https://blog.csdn.net/sunhuaqiang1/article/details/70232679\n *\n * @author llxiao\n * @version 1.0, 2019/9/29 10:58\n * @since JDK 1.8\n */\n@Slf4j\npublic class ImagePHashUtil\n{\n private int size = 32;\n private int smallerSize = 8;\n\n /**\n * 匹配度阀值，两者图片的海明值低于指定值则说明为同一张图片\n */\n\n private int matchThreshold = 5;\n /**\n * 是否需要校验图片，默认需要校验\n */\n private boolean check = true;\n\n private ColorConvertOp colorConvert = new ColorConvertOp(ColorSpace.getInstance(ColorSpace.CS_GRAY), null);\n\n public ImagePHashUtil()\n {\n initCoefficients();\n }\n\n /**\n * [简要描述]: verify = ParamVerify.class;\n String fieldName;\n ParamVerify paramVerify;\n String reg;\n String fValue;\n for (Field field : farray)\n {\n // 获取其中字段\n fieldName = field.getName();\n // 判断是否被chkstring注解所标识\n if (field.isAnnotationPresent(verify))\n {\n // 返回这个类所标识的注解对象\n paramVerify = field.getAnnotation(verify);\n\n // 可以为空\n boolean canBlank = paramVerify.canBlank();\n // 设置权限\n field.setAccessible(true);\n\n // 获取属性值\n fValue = String.valueOf(field.get(object));\n if (!canBlank)\n {\n // 必填校验\n if (StringUtils.isBlank(fValue))\n {\n log.info(\"缺少:{}必填参数\", fieldName);\n // 如果字段是为空\n throw new CommonException(generateCode(moduleCode, CommonException.REQUIRED_PARAM_SUFFIX), String\n .format(\"缺少:%s必填参数\", fieldName));\n }\n\n int maxLeng = paramVerify.maxLeng();\n // 参数最大长度校验\n if (0 != maxLeng && fValue.length() > maxLeng)\n {\n log.info(\"求参数:{}过长\", fieldName);\n throw new CommonException(generateCode(moduleCode, CommonException.ILLEGAL_PARAM_SUFFIX), String\n .format(\"参数:%s非法\", fieldName));\n }\n\n // 正则校验\n reg = paramVerify.regex();\n if (StringUtils.isNotBlank(reg) && !fValue.matches(reg))\n {\n log.info(\"请求参数:{}非法\", fieldName);\n throw new CommonException(generateCode(moduleCode, CommonException.ILLEGAL_PARAM_SUFFIX), String\n .format(\"参数:%s非法\", fieldName));\n }\n }\n }\n }\n }\n catch (Exception e)\n {\n log.error(\"系统内部错误\", e);\n throw new CommonException(CommonExceptionEnum.SYSTEM_ERROR);\n }\n }\n\n private static int generateCode(int moduleCode, String serviceCode)\n {\n String errorCode = moduleCode + serviceCode;\n return Integer.parseInt(errorCode);\n }\n}\n"
},
{
"path": "SpringCloud-Common/src/main/java/com/xiao/springcloud/demo/common/validator/ParamVerify.java",
"content": "/*\n * Winner \n * 文件名 :ParamVerify.java\n * 创建人 :llxiao\n * 创建时间:2017年12月27日\n*/\n\npackage com.xiao.springcloud.demo.common.validator;\n\nimport java.lang.annotation.Retention;\nimport java.lang.annotation.Target;\n\nimport static java.lang.annotation.ElementType.FIELD;\nimport static java.lang.annotation.RetentionPolicy.RUNTIME;\n\n/**\n * [简要描述]:参数校验注解\r\n\t4.0.0 \r\n\t\r\n\t\tcom.xiao.skywalking.demo \r\n\t\tSpringCloud-Demo \r\n\t\t0.0.1-SNAPSHOT \r\n\t \r\n\tSpringCloud-ConfigCenter \r\n\t配置中心 \r\n\r\n\t\r\n\t\t\r\n\t\t\torg.springframework.boot \r\n\t\t\tspring-boot-starter-test \r\n\t\t\ttest \r\n\t\t \r\n\r\n\t\t\r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-config-server \r\n\t\t \r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t \r\n\r\n\t\r\n\t\t${artifactId} \r\n\t\t\r\n\t\t\t\r\n\t\t\t\t${project.build.directory}/classes \r\n\t\t\t\tsrc/main/resources \r\n\t\t\t\ttrue \r\n\t\t\t\t\r\n\t\t\t\t\t**/*.xml \r\n\t\t\t\t\t**/*.yml \r\n\t\t\t\t\t**/*.properties \r\n\t\t\t\t\tMETA-INF/** \r\n\t\t\t\t \r\n\t\t\t \r\n\t\t \r\n\t\t\r\n\t\t\t\r\n\t\t\t\torg.springframework.boot \r\n\t\t\t\tspring-boot-maven-plugin \r\n\t\t\t \r\n\t\t \r\n\t \r\n "
},
{
"path": "SpringCloud-ConfigCenter/src/main/java/com/xiao/springcloud/configure/ConfigureApplication.java",
"content": "/*\r\n * Winner \r\n * 文件名 :ConfigureApplication.java\r\n * 创建人 :llxiao\r\n * 创建时间:2018年8月9日\r\n*/\r\n\r\npackage com.xiao.springcloud.configure;\r\n\r\nimport org.springframework.boot.SpringApplication;\r\nimport org.springframework.boot.autoconfigure.SpringBootApplication;\r\nimport org.springframework.cloud.config.server.EnableConfigServer;\r\n\r\n/**\r\n * [简要描述]:\r\n 4.0.0 \r\n \r\n com.xiao.skywalking.demo \r\n SpringCloud-Demo \r\n 0.0.1-SNAPSHOT \r\n \r\n SpringCloud-Configure \r\n pom \r\n "
},
{
"path": "SpringCloud-Configure/redisson/redission-dev.yml",
"content": "# 线程池数量，默认值: 当前处理核数量 * 2\n##threads: 0\n# Netty线程池数量，默认值: 当前处理核数量 * 2\n##nettyThreads: 0\n# Redisson的对象编码类是用于将对象进行序列化和反序列化，默认：JsonJacksonCodec\n##codec: ! {}\n# 传输模式 默认NIO\n# 可选参数：\n# TransportMode.NIO,\n# TransportMode.EPOLL - 需要依赖里有netty-transport-native-epoll包（Linux）\n# TransportMode.KQUEUE - 需要依赖里有 netty-transport-native-kqueue包（macOS）\n##transportMode: \"NIO\"\n# 监控锁的看门狗超时，单位：毫秒，默认3000ms.该参数只适用于分布式锁的加锁请求中未明确使用leaseTimeout参数的情况\n##lockWatchdogTimeout: 3000\n# 保持订阅发布顺序\n##keepPubSubOrder: true\n# 单节点模式\nsingleServerConfig:\n idleConnectionTimeout: 10000\n pingTimeout: 1000\n connectTimeout: 10000\n timeout: 3000\n retryAttempts: 3\n retryInterval: 1500\n reconnectionTimeout: 3000\n failedAttempts: 3\n subscriptionsPerConnection: 5\n subscriptionConnectionMinimumIdleSize: 1\n subscriptionConnectionPoolSize: 50\n connectionMinimumIdleSize: 32\n connectionPoolSize: 64\n database: 0\n address: redis://localhost:6379\n dnsMonitoringInterval: 5000"
},
{
"path": "SpringCloud-Configure/redisson/redission-sentinel-dev.yml",
"content": "# 线程池数量，默认值: 当前处理核数量 * 2\n##threads: 0\n# Netty线程池数量，默认值: 当前处理核数量 * 2\n##nettyThreads: 0\n# Redisson的对象编码类是用于将对象进行序列化和反序列化，默认：JsonJacksonCodec\n##codec: ! {}\n# 传输模式 默认NIO\n# 可选参数：\n# TransportMode.NIO,\n# TransportMode.EPOLL - 需要依赖里有netty-transport-native-epoll包（Linux）\n# TransportMode.KQUEUE - 需要依赖里有 netty-transport-native-kqueue包（macOS）\n##transportMode: \"NIO\"\n# 监控锁的看门狗超时，单位：毫秒，默认3000ms.该参数只适用于分布式锁的加锁请求中未明确使用leaseTimeout参数的情况\n##lockWatchdogTimeout: 3000\n# 保持订阅发布顺序\n##keepPubSubOrder: true\n# sentinel模式\nsentinelServersConfig:\n idleConnectionTimeout: 10000\n pingTimeout: 1000\n connectTimeout: 10000\n timeout: 3000\n retryAttempts: 3\n retryInterval: 1500\n subscriptionsPerConnection: 5\n clientName: null\n subscriptionConnectionMinimumIdleSize: 1\n subscriptionConnectionPoolSize: 50\n slaveConnectionMinimumIdleSize: 32\n slaveConnectionPoolSize: 64\n masterConnectionMinimumIdleSize: 32\n masterConnectionPoolSize: 64\n readMode: \"SLAVE\"\n subscriptionMode: \"SLAVE\"\n sentinelAddresses:\n - \"redis://localhost:26379\"\n masterName: \"mymaster\"\n database: 0"
},
{
"path": "SpringCloud-Configure/redisson/redisson-cloud.yml",
"content": "# 线程池数量，默认值: 当前处理核数量 * 2\n##threads: 0\n# Netty线程池数量，默认值: 当前处理核数量 * 2\n##nettyThreads: 0\n# Redisson的对象编码类是用于将对象进行序列化和反序列化，默认：JsonJacksonCodec\n##codec: ! {}\n# 传输模式 默认NIO\n# 可选参数：\n#TransportMode.NIO,\n#TransportMode.EPOLL - 需要依赖里有netty-transport-native-epoll包（Linux）\n#TransportMode.KQUEUE - 需要依赖里有 netty-transport-native-kqueue包（macOS）\n##transportMode: \"NIO\"\n# 监控锁的看门狗超时，单位：毫秒，默认3000ms.该参数只适用于分布式锁的加锁请求中未明确使用leaseTimeout参数的情况\n##lockWatchdogTimeout: 3000\n# 保持订阅发布顺序\n##keepPubSubOrder: true\n# 云托管模式-支持：Azure Redis、Alibaba Reidis、AWS Redis\nreplicatedServersConfig:\n idleConnectionTimeout: 10000\n pingTimeout: 1000\n connectTimeout: 10000\n timeout: 3000\n retryAttempts: 3\n retryInterval: 1500\n reconnectionTimeout: 3000\n failedAttempts: 3\n password: null\n subscriptionsPerConnection: 5\n clientName: null\n #loadBalancer: ! {}\n slaveSubscriptionConnectionMinimumIdleSize: 1\n slaveSubscriptionConnectionPoolSize: 50\n slaveConnectionMinimumIdleSize: 32\n slaveConnectionPoolSize: 64\n masterConnectionMinimumIdleSize: 32\n masterConnectionPoolSize: 64\n readMode: \"SLAVE\"\n nodeAddresses:\n - \"redis://127.0.0.1:2812\"\n - \"redis://127.0.0.1:2815\"\n - \"redis://127.0.0.1:2813\"\n scanInterval: 1000"
},
{
"path": "SpringCloud-Configure/redisson/redisson-cluster-dev.yml",
"content": "# 线程池数量，默认值: 当前处理核数量 * 2\n##threads: 0\n# Netty线程池数量，默认值: 当前处理核数量 * 2\n##nettyThreads: 0\n# Redisson的对象编码类是用于将对象进行序列化和反序列化，默认：JsonJacksonCodec\n##codec: ! {}\n# 传输模式 默认NIO\n# 可选参数：\n# TransportMode.NIO,\n# TransportMode.EPOLL - 需要依赖里有netty-transport-native-epoll包（Linux）\n# TransportMode.KQUEUE - 需要依赖里有 netty-transport-native-kqueue包（macOS）\n##transportMode: \"NIO\"\n# 监控锁的看门狗超时，单位：毫秒，默认3000ms.该参数只适用于分布式锁的加锁请求中未明确使用leaseTimeout参数的情况\n##lockWatchdogTimeout: 3000\n# 保持订阅发布顺序\n##keepPubSubOrder: true\n# 集群模式\nclusterServersConfig:\n idleConnectionTimeout: 10000\n pingTimeout: 1000\n connectTimeout: 10000\n timeout: 3000\n retryAttempts: 3\n retryInterval: 1500\n reconnectionTimeout: 3000\n #执行失败最大次数。默认值：3\n failedAttempts: 3\n # 单个连接最大订阅数量，默认值5\n subscriptionsPerConnection: 5\n clientName: null\n #负载均衡算法类的选择 3.5.7不支持\n #默认值： org.redisson.connection.balancer.RoundRobinLoadBalancer\n #在多Redis服务节点的环境里，可以选用以下几种负载均衡方式选择一个节点：\n #org.redisson.connection.balancer.WeightedRoundRobinBalancer - 权重轮询调度算法\n #org.redisson.connection.balancer.RoundRobinLoadBalancer - 轮询调度算法\n #org.redisson.connection.balancer.RandomLoadBalancer - 随机调度算法\n #loadBalancer: ! {}\n slaveSubscriptionConnectionMinimumIdleSize: 1\n slaveSubscriptionConnectionPoolSize: 50\n slaveConnectionMinimumIdleSize: 32\n slaveConnectionPoolSize: 64\n masterConnectionMinimumIdleSize: 32\n masterConnectionPoolSize: 64\n #读取操作的负载均衡模式，默认值： SLAVE（只在从服务节点里读取）\n #可用值为： SLAVE - 只在从服务节点里读取。 MASTER - 只在主服务节点里读取。 MASTER_SLAVE - 在主从服务节点里都可以读取。\n readMode: \"SLAVE\"\n #订阅操作的负载均衡模式,默认值：SLAVE（只在从服务节点里订阅）\n #可用值为： SLAVE - 只在从服务节点里订阅。 MASTER - 只在主服务节点里订阅\n subscriptionMode: \"SLAVE\"\n #启用SSL终端识别 默认值：true\n #sslEnableEndpointIdentification: false\n nodeAddresses:\n - \"redis://localhost:7379\"\n - \"redis://localhost:7380\"\n - \"redis://localhost:7381\"\n - \"redis://localhost1:7379\"\n - \"redis://localhost1:7380\"\n - \"redis://localhost1:7381\"\n #集群扫描间隔时间，默认1000ms\n scanInterval: 1000"
},
{
"path": "SpringCloud-Configure/redisson/redisson-cluster-test.yml",
"content": "# 线程池数量，默认值: 当前处理核数量 * 2\n##threads: 0\n# Netty线程池数量，默认值: 当前处理核数量 * 2\n##nettyThreads: 0\n# Redisson的对象编码类是用于将对象进行序列化和反序列化，默认：JsonJacksonCodec\n##codec: ! {}\n# 传输模式 默认NIO\n# 可选参数：\n# TransportMode.NIO,\n# TransportMode.EPOLL - 需要依赖里有netty-transport-native-epoll包（Linux）\n# TransportMode.KQUEUE - 需要依赖里有 netty-transport-native-kqueue包（macOS）\n##transportMode: \"NIO\"\n# 监控锁的看门狗超时，单位：毫秒，默认3000ms.该参数只适用于分布式锁的加锁请求中未明确使用leaseTimeout参数的情况\n##lockWatchdogTimeout: 3000\n# 保持订阅发布顺序\n##keepPubSubOrder: true\n# 集群模式\nclusterServersConfig:\n idleConnectionTimeout: 10000\n pingTimeout: 1000\n connectTimeout: 10000\n timeout: 3000\n retryAttempts: 3\n retryInterval: 1500\n reconnectionTimeout: 3000\n #执行失败最大次数。默认值：3\n failedAttempts: 3\n # 单个连接最大订阅数量，默认值5\n subscriptionsPerConnection: 5\n clientName: null\n #负载均衡算法类的选择 3.5.7不支持\n #默认值： org.redisson.connection.balancer.RoundRobinLoadBalancer\n #在多Redis服务节点的环境里，可以选用以下几种负载均衡方式选择一个节点：\n #org.redisson.connection.balancer.WeightedRoundRobinBalancer - 权重轮询调度算法\n #org.redisson.connection.balancer.RoundRobinLoadBalancer - 轮询调度算法\n #org.redisson.connection.balancer.RandomLoadBalancer - 随机调度算法\n #loadBalancer: ! {}\n slaveSubscriptionConnectionMinimumIdleSize: 1\n slaveSubscriptionConnectionPoolSize: 50\n slaveConnectionMinimumIdleSize: 32\n slaveConnectionPoolSize: 64\n masterConnectionMinimumIdleSize: 32\n masterConnectionPoolSize: 64\n #读取操作的负载均衡模式，默认值： SLAVE（只在从服务节点里读取）\n #可用值为： SLAVE - 只在从服务节点里读取。 MASTER - 只在主服务节点里读取。 MASTER_SLAVE - 在主从服务节点里都可以读取。\n readMode: \"SLAVE\"\n #订阅操作的负载均衡模式,默认值：SLAVE（只在从服务节点里订阅）\n #可用值为： SLAVE - 只在从服务节点里订阅。 MASTER - 只在主服务节点里订阅\n subscriptionMode: \"SLAVE\"\n #启用SSL终端识别 默认值：true\n #sslEnableEndpointIdentification: false\n nodeAddresses:\n - \"redis://localhost:7379\"\n - \"redis://localhost:7380\"\n - \"redis://localhost:7381\"\n - \"redis://localhost1:7379\"\n - \"redis://localhost1:7380\"\n - \"redis://localhost1:7381\"\n #集群扫描间隔时间，默认1000ms\n scanInterval: 1000"
},
{
"path": "SpringCloud-Consumer/pom.xml",
"content": "\r\n\t4.0.0 \r\n\t\r\n\t\tcom.xiao.skywalking.demo \r\n\t\tSpringCloud-Demo \r\n\t\t0.0.1-SNAPSHOT \r\n\t \r\n\tSpringCloud-Consumer \r\n\r\n\t\r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-starter-eureka \r\n\t\t \r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-starter-feign \r\n\t\t \r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-starter-ribbon \r\n\t\t \r\n\t\t\r\n\t\t\torg.springframework.boot \r\n\t\t\tspring-boot-starter-web \r\n\t\t \r\n\r\n\t\t\r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-starter-hystrix \r\n\t\t \r\n\r\n\t\t\r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-starter-config \r\n\t\t \r\n\t\t\r\n\t\t\r\n\t\t\torg.springframework.boot \r\n\t\t\tspring-boot-starter-actuator \r\n\t\t \r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\r\n\t\t\r\n\t\t\r\n\t\t\t\r\n\t\t\t\r\n\t\t\r\n\t\t\r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-starter-sleuth \r\n\t\t \r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-stream-binder-kafka \r\n\t\t \r\n\t\t\r\n\t\t\torg.springframework.cloud \r\n\t\t\tspring-cloud-sleuth-stream \r\n\t\t \r\n\r\n\t\t\r\n\t\t\torg.springframework.boot \r\n\t\t\tspring-boot-starter-test \r\n\t\t\ttest \r\n\t\t \r\n\r\n\t\t\r\n\t\t\torg.projectlombok \r\n\t\t\tlombok \r\n\t\t\t1.16.18 \r\n\t\t\ttrue \r\n\t\t \r\n\t \r\n\r\n\t\r\n\t\t\r\n\t\t\t\r\n\t\t\t\t${project.build.directory}/classes \r\n\t\t\t\tsrc/main/resources \r\n\t\t\t\ttrue \r\n\t\t\t\t\r\n\t\t\t\t\t**/*.xml \r\n\t\t\t\t\t**/*.yml \r\n\t\t\t\t\t**/*.properties \r\n\t\t\t\t\tMETA-INF/** \r\n\t\t\t\t \r\n\t\t\t \r\n\t\t \r\n\t\t\r\n\t\t\t\r\n\t\t\t\torg.springframework.boot \r\n\t\t\t\tspring-boot-maven-plugin \r\n\t\t\t \r\n\t\t \r\n\t \r\n\r\n "
},
{
"path": "SpringCloud-Consumer/src/main/java/com/xiao/skywalking/consumer/ConsumerApp.java",
"content": "/*\r\n * Winner \r\n * 文件名 :ConsumerApp.java\r\n * 创建人 :llxiao\r\n * 创建时间:2018年3月30日\r\n*/\r\n\r\npackage com.xiao.skywalking.consumer;\r\n\r\nimport org.springframework.boot.SpringApplication;\r\nimport org.springframework.boot.autoconfigure.SpringBootApplication;\r\nimport org.springframework.cloud.client.circuitbreaker.EnableCircuitBreaker;\r\nimport org.springframework.cloud.client.discovery.EnableDiscoveryClient;\r\nimport org.springframework.cloud.client.loadbalancer.LoadBalanced;\r\nimport org.springframework.cloud.netflix.feign.EnableFeignClients;\r\nimport org.springframework.context.annotation.Bean;\r\nimport org.springframework.web.client.RestTemplate;\r\n\r\n/**\r\n * [简要描述]:\n {\n\n /**\n * Whether this component supports the given controller method return type\n * and the selected {@code HttpMessageConverter} type.\n *\n * @param returnType the return type\n * @param converterType the selected converter type\n * @return {@code true} if {@link #beforeBodyWrite} should be invoked;\n * {@code false} otherwise\n */\n @Override\n public boolean supports(MethodParameter returnType, Class> converterType)\n {\n return true;\n }\n\n /**\n * Invoked after an {@code HttpMessageConverter} is selected and just before\n * its write method is invoked.\n *\n * @param body the body to be written\n * @param returnType the return type of the controller method\n * @param selectedContentType the content type selected through content negotiation\n * @param selectedConverterType the converter type selected to write to the response\n * @param request the current request\n * @param response the current response\n * @return the body that was passed in or a modified (possibly new) instance\n */\n @Override\n public Object beforeBodyWrite(Object body, MethodParameter returnType, MediaType selectedContentType,\n Class> selectedConverterType, ServerHttpRequest request,\n ServerHttpResponse response)\n {\n if (body instanceof ResponseData)\n {\n return body;\n }\n // 针对特殊DTO 不处理，比如mybatis的分页类\n // if (body instanceof PageInfo)\n // {\n // return body;\n // }\n return new ResponseData<>(body);\n }\n }\n}\n"
},
{
"path": "SpringCloud-Consumer/src/main/java/com/xiao/skywalking/consumer/common/response/ErrorResponseData.java",
"content": "package com.xiao.skywalking.consumer.common.response;\n\nimport lombok.NoArgsConstructor;\n\n/**\n * 请求失败的返回\n */\n@NoArgsConstructor\npublic class ErrorResponseData extends ResponseData {\n\n public ErrorResponseData(String message) {\n super(false, DEFAULT_ERROR_CODE, message, null);\n }\n\n public ErrorResponseData(Integer code, String message) {\n super(false, code, message, null);\n }\n\n public ErrorResponseData(Integer code, String message, T data) {\n super(false, code, message, data);\n }\n}\n"
},
{
"path": "SpringCloud-Consumer/src/main/java/com/xiao/skywalking/consumer/common/response/ResponseData.java",
"content": "package com.xiao.skywalking.consumer.common.response;\n\nimport com.fasterxml.jackson.databind.annotation.JsonSerialize;\nimport com.xiao.skywalking.consumer.common.ExceptionEnum;\nimport lombok.AllArgsConstructor;\nimport lombok.Data;\nimport lombok.NoArgsConstructor;\n\nimport java.io.Serializable;\n\n/**\n * 返回给前台的通用包装。\n */\n@Data\n@NoArgsConstructor\n@AllArgsConstructor\n@JsonSerialize(include = JsonSerialize.Inclusion.NON_NULL)\npublic class ResponseData implements Serializable\n{\n\n public static final String DEFAULT_SUCCESS_MESSAGE = \"请求成功\";\n\n public static final String DEFAULT_ERROR_MESSAGE = \"网络异常\";\n\n public static final Integer DEFAULT_SUCCESS_CODE = 200;\n\n public static final Integer DEFAULT_ERROR_CODE = 500;\n\n private static final long serialVersionUID = 276410732109056930L;\n\n /**\n * 请求是否成功\n */\n private Boolean success;\n\n /**\n * 响应状态码\n */\n private Integer code;\n\n /**\n * 响应信息\n */\n private String message;\n\n /**\n * 响应对象\n */\n private T data;\n\n public ResponseData(T data)\n {\n this.success = true;\n this.code = 0;\n this.data = data;\n }\n\n public ResponseData(int code, String message)\n {\n this.success = false;\n this.code = code;\n this.message = message;\n }\n\n public static SuccessResponseData success()\n {\n return new SuccessResponseData<>(null);\n }\n\n public static SuccessResponseData success(Object data)\n {\n return new SuccessResponseData<>(data);\n }\n\n public static SuccessResponseData success(Integer code, String message, Object data)\n {\n return new SuccessResponseData<>(code, message, data);\n }\n\n public static ErrorResponseData error(String message)\n {\n return new ErrorResponseData(message);\n }\n\n public static ErrorResponseData error(Integer code, String message)\n {\n return new ErrorResponseData(code, message);\n }\n\n public static ErrorResponseData error(Integer code, String message, Object object)\n {\n return new ErrorResponseData<>(code, message, object);\n }\n\n public static ErrorResponseData error(ExceptionEnum exceptionEnum)\n {\n return new ErrorResponseData(exceptionEnum.getErrorCode(), exceptionEnum.getErrorMsg());\n }\n}\n"
},
{
"path": "SpringCloud-Consumer/src/main/java/com/xiao/skywalking/consumer/common/response/SuccessResponseData.java",
"content": "package com.xiao.skywalking.consumer.common.response;\n\nimport lombok.NoArgsConstructor;\n\n/**\n * 请求成功的返回\n */\n@NoArgsConstructor\npublic class SuccessResponseData extends ResponseData {\n\n public SuccessResponseData(T data) {\n super(true, DEFAULT_SUCCESS_CODE, DEFAULT_SUCCESS_MESSAGE, data);\n }\n\n public SuccessResponseData(Integer code, String message, T data) {\n super(true, code, message, data);\n }\n}\n"
},
{
"path": "SpringCloud-Consumer/src/main/java/com/xiao/skywalking/consumer/controller/FeignContoller.java",
"content": "/*\r\n * Winner \r\n * 文件名 :FeignContoller.java\r\n * 创建人 :llxiao\r\n * 创建时间:2018年3月30日\r\n*/\r\n\r\npackage com.xiao.skywalking.consumer.controller;\r\n\r\nimport org.springframework.beans.factory.annotation.Autowired;\r\nimport org.springframework.cloud.context.config.annotation.RefreshScope;\r\nimport org.springframework.web.bind.annotation.RequestMapping;\r\nimport org.springframework.web.bind.annotation.RestController;\r\n\r\nimport com.xiao.skywalking.consumer.feign.FeignService;\r\nimport com.xiao.skywalking.consumer.ribbon.RibbonService;\r\n\r\n/**\r\n * [简要描述]: {\n \n @Override\n public ConsumerFeignService create(Throwable cause) {\n return new ConsumerFeignService() {\n @Override\n public User getUserById(long id) {\n return new User();\n }\n \n @Override\n public String echo(String name) {\n return \"echo error: \" + name;\n }\n };\n }\n}\n运行后，关闭服务提供者，发现熔断并没有生效，没有像单独使用@HystrixCommand时进入fallback方法，查了很多方式，发现原来是feign的hystix的配置开关没有打开\n\n解决方法，在application.yml中增加配置如下：\nfeign:\n hystrix:\n enabled: true\n"
},
{
"path": "SpringCloud-Consumer/src/main/java/com/xiao/skywalking/consumer/feign/impl/FeignServiceImpl.java",
"content": "/*\r\n * Winner \r\n * 文件名 :FeignServiceImpl.java\r\n * 创建人 :llxiao\r\n * 创建时间:2018年3月30日\r\n*/\r\n\r\npackage com.xiao.skywalking.consumer.feign.impl;\r\n\r\nimport org.springframework.beans.factory.annotation.Value;\r\nimport org.springframework.stereotype.Component;\r\n\r\nimport com.xiao.skywalking.consumer.feign.FeignService;\r\n\r\n/**\r\n * [简要描述]:\n com.winner.config.center \n winner-starter-config \n 1.0-SNAPSHOT \n ``\n \n SpringCloud-Custom-ConfigCenter \n com.xiao.skywalking.demo \n 0.0.1-SNAPSHOT \n \n 4.0.0 \n\n custom-config-client \n\n \n 4.1.42.Final \n \n\n \n \n org.springframework.boot \n spring-boot-configuration-processor \n true \n \n \n org.springframework.boot \n spring-boot-autoconfigure \n \n \n org.springframework.boot \n spring-boot-starter-logging \n true \n \n \n org.springframework.cloud \n spring-cloud-commons \n \n \n org.springframework.cloud \n spring-cloud-context \n \n \n org.springframework \n spring-web \n \n \n com.fasterxml.jackson.core \n jackson-annotations \n \n \n org.springframework.retry \n spring-retry \n true \n \n \n org.springframework.boot \n spring-boot-starter-actuator \n true \n \n \n org.springframework.boot \n spring-boot-starter-aop \n true \n \n \n com.fasterxml.jackson.core \n jackson-databind \n \n \n org.springframework.boot \n spring-boot-starter-test \n test \n \n\n \n \n com.dyuproject.protostuff \n protostuff-core \n 1.1.2 \n \n \n \n com.dyuproject.protostuff \n protostuff-runtime \n 1.1.2 \n \n \n \n org.objenesis \n objenesis \n 2.1 \n \n \n\n \n io.netty \n netty-all \n ${netty.version} \n \n \n org.apache.commons \n commons-lang3 \n 3.6 \n \n \n\n "
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigClientAutoConfiguration.java",
"content": "/*\n * Copyright 2013-2014 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\npackage com.xiao.custom.config.client.configuration;\n\nimport com.xiao.custom.config.client.netty.client.NettyClient;\nimport org.springframework.beans.factory.BeanFactoryUtils;\nimport org.springframework.boot.actuate.health.HealthIndicator;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnBean;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnClass;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnProperty;\nimport org.springframework.cloud.context.refresh.ContextRefresher;\nimport org.springframework.context.ApplicationContext;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\nimport org.springframework.core.env.Environment;\n\n/**\n * Expose a ConfigClientProperties just so that there is a way to inspect the properties\n * bound to it. It won't be available in time for autowiring into the bootstrap context,\n * but the values in this properties object will be the same as the ones used to bind to\n * the config server, if there is one.\n *\n * @author Dave Syer\n * @author Marcos Barbero\n */\n@Configuration\npublic class ConfigClientAutoConfiguration\n{\n @Bean\n public ConfigClientProperties configClientProperties(Environment environment, ApplicationContext context)\n {\n if (context.getParent() != null && BeanFactoryUtils\n .beanNamesForTypeIncludingAncestors(context.getParent(), ConfigClientProperties.class).length > 0)\n {\n return BeanFactoryUtils.beanOfTypeIncludingAncestors(context.getParent(), ConfigClientProperties.class);\n }\n ConfigClientProperties client = new ConfigClientProperties(environment);\n return client;\n }\n\n @Bean\n public ConfigClientHealthProperties configClientHealthProperties()\n {\n return new ConfigClientHealthProperties();\n }\n\n @Configuration\n @ConditionalOnClass(HealthIndicator.class)\n @ConditionalOnBean(ConfigServicePropertySourceLocator.class)\n @ConditionalOnProperty(value = \"health.config.enabled\", matchIfMissing = true)\n protected static class ConfigServerHealthIndicatorConfiguration\n {\n\n @Bean\n public ConfigServerHealthIndicator configServerHealthIndicator(ConfigServicePropertySourceLocator locator,\n ConfigClientHealthProperties properties, Environment environment)\n {\n return new ConfigServerHealthIndicator(locator, environment, properties);\n }\n }\n\n @Configuration\n @ConditionalOnClass(ContextRefresher.class)\n @ConditionalOnBean(ContextRefresher.class)\n @ConditionalOnProperty(value = \"spring.cloud.config.watch.enabled\")\n protected static class ConfigClientWatchConfiguration\n {\n @Bean\n public ConfigClientWatch configClientWatch(ContextRefresher contextRefresher)\n {\n return new ConfigClientWatch(contextRefresher);\n }\n }\n\n @Bean\n @ConditionalOnProperty(name = \"spring.cloud.config.custom\", havingValue = \"true\")\n public NettyClient nettyClient()\n {\n return new NettyClient();\n }\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigClientHealthProperties.java",
"content": "/*\n * Copyright 2013-2016 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n *\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport org.springframework.boot.context.properties.ConfigurationProperties;\n\n/**\n * @author Spencer Gibb\n */\n@ConfigurationProperties(\"health.config\")\npublic class ConfigClientHealthProperties {\n\t/**\n\t * Flag to indicate that the config server health indicator should be installed.\n\t */\n\tboolean enabled;\n\n\t/**\n\t * Time to live for cached result, in milliseconds. Default 300000 (5 min).\n\t */\n\tprivate long timeToLive = 60 * 5 * 1000;\n\n\tpublic boolean isEnabled() {\n\t\treturn this.enabled;\n\t}\n\n\tpublic void setEnabled(boolean enabled) {\n\t\tthis.enabled = enabled;\n\t}\n\n\tpublic long getTimeToLive() {\n\t\treturn timeToLive;\n\t}\n\n\tpublic void setTimeToLive(long timeToLive) {\n\t\tthis.timeToLive = timeToLive;\n\t}\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigClientProperties.java",
"content": "/*\n * Copyright 2013-2014 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport org.springframework.beans.BeanUtils;\nimport org.springframework.beans.factory.annotation.Value;\nimport org.springframework.boot.context.properties.ConfigurationProperties;\nimport org.springframework.core.env.Environment;\nimport org.springframework.util.StringUtils;\nimport org.springframework.web.util.UriComponentsBuilder;\n\nimport java.net.MalformedURLException;\nimport java.net.URL;\n\n/**\n * @author Dave Syer\n */\n@ConfigurationProperties(ConfigClientProperties.PREFIX)\npublic class ConfigClientProperties\n{\n\n public static final String PREFIX = \"spring.cloud.config\";\n public static final String TOKEN_HEADER = \"X-Config-Token\";\n public static final String STATE_HEADER = \"X-Config-State\";\n\n /**\n * 自定义配置中心,默认不使用\n * true使用，false不适用\n */\n private boolean custom = false;\n\n /**\n * server port\n */\n @Value(\"${server.port:}\")\n private int serverPort;\n\n /**\n * 服务端netty端口号\n */\n @Value(\"${netty.server.port:8999}\")\n private int nettyPort;\n\n /**\n * Flag to say that remote configuration is enabled. Default true;\n */\n private boolean enabled = true;\n\n /**\n * The default profile to use when fetching remote configuration (comma-separated).\n * Default is \"default\".\n */\n private String profile = \"default\";\n\n /**\n * Name of application used to fetch remote properties.\n */\n @Value(\"${spring.application.name:application}\")\n private String name;\n\n /**\n * The label name to use to pull remote configuration properties. The default is set\n * on the server (generally \"master\" for a git based server).\n */\n private String label;\n\n /**\n * The username to use (HTTP Basic) when contacting the remote server.\n */\n private String username;\n\n /**\n * The password to use (HTTP Basic) when contacting the remote server.\n */\n private String password;\n\n /**\n * The URI of the remote server (default http://localhost:8888).\n */\n private String uri = \"http://localhost:8888\";\n\n /**\n * Discovery properties.\n */\n private Discovery discovery = new Discovery();\n\n /**\n * Flag to indicate that failure to connect to the server is fatal (default false).\n */\n private boolean failFast = false;\n\n /**\n * Security Token passed thru to underlying environment repository.\n */\n private String token;\n\n /**\n * Authorization token used by the client to connect to the server.\n */\n private String authorization;\n\n private ConfigClientProperties()\n {\n }\n\n public ConfigClientProperties(Environment environment)\n {\n String[] profiles = environment.getActiveProfiles();\n if (profiles.length == 0)\n {\n profiles = environment.getDefaultProfiles();\n }\n this.setProfile(StringUtils.arrayToCommaDelimitedString(profiles));\n }\n\n public boolean isCustom()\n {\n return custom;\n }\n\n public void setCustom(boolean custom)\n {\n this.custom = custom;\n }\n\n public int getNettyPort()\n {\n return nettyPort;\n }\n\n public void setNettyPort(int nettyPort)\n {\n this.nettyPort = nettyPort;\n }\n\n public boolean isEnabled()\n {\n return this.enabled;\n }\n\n public void setEnabled(boolean enabled)\n {\n this.enabled = enabled;\n }\n\n public String getRawUri()\n {\n return extractCredentials().uri;\n }\n\n public String getUri()\n {\n return this.uri;\n }\n\n public void setUri(String url)\n {\n this.uri = url;\n }\n\n public String getName()\n {\n return this.name;\n }\n\n public void setName(String name)\n {\n this.name = name;\n }\n\n public String getProfile()\n {\n return this.profile;\n }\n\n public void setProfile(String env)\n {\n this.profile = env;\n }\n\n public String getLabel()\n {\n return this.label;\n }\n\n public void setLabel(String label)\n {\n this.label = label;\n }\n\n public String getUsername()\n {\n return extractCredentials().username;\n }\n\n public void setUsername(String username)\n {\n this.username = username;\n }\n\n public String getPassword()\n {\n return extractCredentials().password;\n }\n\n public void setPassword(String password)\n {\n this.password = password;\n }\n\n public Discovery getDiscovery()\n {\n return this.discovery;\n }\n\n public void setDiscovery(Discovery discovery)\n {\n this.discovery = discovery;\n }\n\n public boolean isFailFast()\n {\n return this.failFast;\n }\n\n public void setFailFast(boolean failFast)\n {\n this.failFast = failFast;\n }\n\n public String getToken()\n {\n return this.token;\n }\n\n public void setToken(String token)\n {\n this.token = token;\n }\n\n public String getAuthorization()\n {\n return this.authorization;\n }\n\n public void setAuthorization(String authorization)\n {\n this.authorization = authorization;\n }\n\n public int getServerPort()\n {\n return serverPort;\n }\n\n public void setServerPort(int serverPort)\n {\n this.serverPort = serverPort;\n }\n\n private Credentials extractCredentials()\n {\n Credentials result = new Credentials();\n String uri = this.uri;\n result.uri = uri;\n Credentials explicitCredentials = getUsernamePassword();\n result.username = explicitCredentials.username;\n result.password = explicitCredentials.password;\n try\n {\n URL url = new URL(uri);\n String userInfo = url.getUserInfo();\n // no credentials in url, return explicit credentials\n if (StringUtils.isEmpty(userInfo) || \":\".equals(userInfo))\n {\n return result;\n }\n String bare = UriComponentsBuilder.fromHttpUrl(uri).userInfo(null).build().toUriString();\n result.uri = bare;\n // handle the password only case\n if (!userInfo.contains(\":\"))\n {\n userInfo = userInfo + \":\";\n }\n String[] split = userInfo.split(\":\");\n // set username and password from uri\n result.username = split[0];\n result.password = split[1];\n\n // override password if explicitly set\n if (explicitCredentials.password != null)\n {\n // Explicit username / password takes precedence\n result.password = explicitCredentials.password;\n }\n // override username if explicitly set\n if (!\"user\".equals(explicitCredentials.username))\n {\n // But the username can be overridden\n result.username = explicitCredentials.username;\n }\n return result;\n }\n catch (MalformedURLException e)\n {\n throw new IllegalStateException(\"Invalid URL: \" + uri);\n }\n }\n\n private Credentials getUsernamePassword()\n {\n Credentials credentials = new Credentials();\n\n if (StringUtils.hasText(this.password))\n {\n credentials.password = this.password.trim();\n }\n\n if (StringUtils.hasText(this.username))\n {\n credentials.username = this.username.trim();\n }\n else\n {\n credentials.username = \"user\";\n }\n return credentials;\n }\n\n private static class Credentials\n {\n private String username;\n private String password;\n private String uri;\n }\n\n public static class Discovery\n {\n public static final String DEFAULT_CONFIG_SERVER = \"configserver\";\n\n /**\n * Flag to indicate that config server discovery is enabled (config server URL will be\n * looked up via discovery).\n */\n private boolean enabled;\n /**\n * Service id to locate config server.\n */\n private String serviceId = DEFAULT_CONFIG_SERVER;\n\n public boolean isEnabled()\n {\n return this.enabled;\n }\n\n public void setEnabled(boolean enabled)\n {\n this.enabled = enabled;\n }\n\n public String getServiceId()\n {\n return this.serviceId;\n }\n\n public void setServiceId(String serviceId)\n {\n this.serviceId = serviceId;\n }\n\n }\n\n public ConfigClientProperties override(Environment environment)\n {\n ConfigClientProperties override = new ConfigClientProperties();\n BeanUtils.copyProperties(this, override);\n override.setName(environment.resolvePlaceholders(\n \"${\" + ConfigClientProperties.PREFIX + \".name:${spring.application.name:application}}\"));\n if (environment.containsProperty(ConfigClientProperties.PREFIX + \".profile\"))\n {\n override.setProfile(environment.getProperty(ConfigClientProperties.PREFIX + \".profile\"));\n }\n if (environment.containsProperty(ConfigClientProperties.PREFIX + \".label\"))\n {\n override.setLabel(environment.getProperty(ConfigClientProperties.PREFIX + \".label\"));\n }\n return override;\n }\n\n @Override\n public String toString()\n {\n return \"ConfigClientProperties [enabled=\" + this.enabled + \", profile=\" + this.profile + \", name=\" + this.name\n + \", label=\" + (this.label == null ? \"\" : this.label) + \", username=\" + this.username + \", password=\"\n + this.password + \", uri=\" + this.uri + \", authorization=\" + this.authorization + \", discovery.enabled=\"\n + this.discovery.enabled + \", failFast=\" + this.failFast + \", token=\" + this.token + \"]\";\n }\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigClientStateHolder.java",
"content": "package com.xiao.custom.config.client.configuration;\n\n/**\n * @author Spencer Gibb\n */\npublic class ConfigClientStateHolder {\n\tprivate static ThreadLocal state = new ThreadLocal<>();\n\n\tpublic static void resetState() {\n\t\tstate.remove();\n\t}\n\n\tpublic static void setState(String newState) {\n\t\tif (newState == null) {\n\t\t\tresetState();\n\t\t\treturn;\n\t\t}\n\t\tstate.set(newState);\n\t}\n\n\tpublic static String getState() {\n\t\treturn state.get();\n\t}\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigClientWatch.java",
"content": "/*\n * Copyright 2013-2016 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport org.apache.commons.logging.Log;\nimport org.apache.commons.logging.LogFactory;\nimport org.springframework.cloud.context.refresh.ContextRefresher;\nimport org.springframework.context.EnvironmentAware;\nimport org.springframework.core.env.Environment;\nimport org.springframework.scheduling.annotation.Scheduled;\n\nimport javax.annotation.PostConstruct;\nimport java.io.Closeable;\nimport java.util.concurrent.atomic.AtomicBoolean;\n\nimport static org.springframework.util.StringUtils.hasText;\n\n/**\n * @author Spencer Gibb\n */\npublic class ConfigClientWatch implements Closeable, EnvironmentAware\n{\n\n private static Log log = LogFactory.getLog(ConfigServicePropertySourceLocator.class);\n\n private final AtomicBoolean running = new AtomicBoolean(false);\n private final ContextRefresher refresher;\n private Environment environment;\n\n public ConfigClientWatch(ContextRefresher refresher)\n {\n this.refresher = refresher;\n }\n\n @Override\n public void setEnvironment(Environment environment)\n {\n this.environment = environment;\n }\n\n @PostConstruct\n public void start()\n {\n this.running.compareAndSet(false, true);\n }\n\n @Scheduled(initialDelayString = \"${spring.cloud.config.watch.initialDelay:180000}\", fixedDelayString = \"${spring.cloud.config.watch.delay:500}\")\n public void watchConfigServer()\n {\n if (this.running.get())\n {\n String newState = this.environment.getProperty(\"config.client.state\");\n String oldState = ConfigClientStateHolder.getState();\n\n // only refresh if state has changed\n if (stateChanged(oldState, newState))\n {\n ConfigClientStateHolder.setState(newState);\n this.refresher.refresh();\n }\n }\n }\n\n /* for testing */ boolean stateChanged(String oldState, String newState)\n {\n return (!hasText(oldState) && hasText(newState)) || (hasText(oldState) && !oldState.equals(newState));\n }\n\n @Override\n public void close()\n {\n this.running.compareAndSet(true, false);\n }\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigServerHealthIndicator.java",
"content": "package com.xiao.custom.config.client.configuration;\n\nimport org.springframework.boot.actuate.health.AbstractHealthIndicator;\nimport org.springframework.boot.actuate.health.Health.Builder;\nimport org.springframework.core.env.CompositePropertySource;\nimport org.springframework.core.env.Environment;\nimport org.springframework.core.env.PropertySource;\n\nimport java.util.ArrayList;\nimport java.util.List;\n\n/**\n * @author Spencer Gibb\n * @author Marcos Barbero\n */\npublic class ConfigServerHealthIndicator extends AbstractHealthIndicator\n{\n\n private ConfigServicePropertySourceLocator locator;\n private ConfigClientHealthProperties properties;\n private Environment environment;\n\n private long lastAccess = 0;\n\n private PropertySource cached;\n\n public ConfigServerHealthIndicator(ConfigServicePropertySourceLocator locator, Environment environment,\n ConfigClientHealthProperties properties)\n {\n this.environment = environment;\n this.locator = locator;\n this.properties = properties;\n }\n\n @Override\n protected void doHealthCheck(Builder builder) throws Exception\n {\n PropertySource propertySource = getPropertySource();\n builder.up();\n if (propertySource instanceof CompositePropertySource)\n {\n List sources = new ArrayList<>();\n for (PropertySource ps : ((CompositePropertySource) propertySource).getPropertySources())\n {\n sources.add(ps.getName());\n }\n builder.withDetail(\"propertySources\", sources);\n }\n else if (propertySource != null)\n {\n builder.withDetail(\"propertySources\", propertySource.toString());\n }\n else\n {\n builder.unknown().withDetail(\"error\", \"no property sources located\");\n }\n }\n\n private PropertySource getPropertySource()\n {\n long accessTime = System.currentTimeMillis();\n if (isCacheStale(accessTime))\n {\n this.lastAccess = accessTime;\n this.cached = locator.locate(this.environment);\n }\n return this.cached;\n }\n\n private boolean isCacheStale(long accessTime)\n {\n if (this.cached == null)\n {\n return true;\n }\n return (accessTime - this.lastAccess) >= this.properties.getTimeToLive();\n }\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigServiceBootstrapConfiguration.java",
"content": "/*\n * Copyright 2013-2014 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport org.aspectj.lang.annotation.Aspect;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.boot.autoconfigure.aop.AopAutoConfiguration;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnClass;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnMissingBean;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnProperty;\nimport org.springframework.boot.context.properties.EnableConfigurationProperties;\nimport org.springframework.context.annotation.Bean;\nimport org.springframework.context.annotation.Configuration;\nimport org.springframework.context.annotation.Import;\nimport org.springframework.core.env.ConfigurableEnvironment;\nimport org.springframework.retry.annotation.EnableRetry;\nimport org.springframework.retry.annotation.Retryable;\nimport org.springframework.retry.interceptor.RetryInterceptorBuilder;\nimport org.springframework.retry.interceptor.RetryOperationsInterceptor;\n\n/**\n * @author Dave Syer\n */\n@Configuration\n@EnableConfigurationProperties\npublic class ConfigServiceBootstrapConfiguration\n{\n\n @Autowired\n private ConfigurableEnvironment environment;\n\n @Bean\n public ConfigClientProperties configClientProperties()\n {\n ConfigClientProperties client = new ConfigClientProperties(this.environment);\n return client;\n }\n\n @Bean\n @ConditionalOnProperty(value = \"spring.cloud.config.enabled\", matchIfMissing = true)\n public ConfigServicePropertySourceLocator configServicePropertySource(ConfigClientProperties properties)\n {\n ConfigServicePropertySourceLocator locator = new ConfigServicePropertySourceLocator(properties);\n return locator;\n }\n\n @ConditionalOnProperty(value = \"spring.cloud.config.failFast\", matchIfMissing = false)\n @ConditionalOnClass({ Retryable.class, Aspect.class, AopAutoConfiguration.class })\n @Configuration\n @EnableRetry(proxyTargetClass = true)\n @Import(AopAutoConfiguration.class)\n @EnableConfigurationProperties(RetryProperties.class)\n protected static class RetryConfiguration\n {\n\n @Bean\n @ConditionalOnMissingBean(name = \"configServerRetryInterceptor\")\n public RetryOperationsInterceptor configServerRetryInterceptor(RetryProperties properties)\n {\n return RetryInterceptorBuilder.stateless()\n .backOffOptions(properties.getInitialInterval(), properties.getMultiplier(), properties\n .getMaxInterval()).maxAttempts(properties.getMaxAttempts()).build();\n }\n }\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/ConfigServicePropertySourceLocator.java",
"content": "/*\n * Copyright 2013-2014 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport com.xiao.custom.config.client.environment.Environment;\nimport com.xiao.custom.config.client.environment.PropertySource;\nimport com.xiao.custom.config.client.netty.util.RemotingUtil;\nimport org.apache.commons.logging.Log;\nimport org.apache.commons.logging.LogFactory;\nimport org.springframework.cloud.bootstrap.config.PropertySourceLocator;\nimport org.springframework.core.annotation.Order;\nimport org.springframework.core.env.CompositePropertySource;\nimport org.springframework.core.env.MapPropertySource;\nimport org.springframework.http.*;\nimport org.springframework.http.client.ClientHttpRequestExecution;\nimport org.springframework.http.client.ClientHttpRequestInterceptor;\nimport org.springframework.http.client.ClientHttpResponse;\nimport org.springframework.http.client.SimpleClientHttpRequestFactory;\nimport org.springframework.retry.annotation.Retryable;\nimport org.springframework.util.Base64Utils;\nimport org.springframework.util.StringUtils;\nimport org.springframework.web.client.HttpClientErrorException;\nimport org.springframework.web.client.HttpServerErrorException;\nimport org.springframework.web.client.RestTemplate;\n\nimport java.io.IOException;\nimport java.util.Arrays;\nimport java.util.HashMap;\nimport java.util.Map;\n\nimport static com.xiao.custom.config.client.configuration.ConfigClientProperties.STATE_HEADER;\nimport static com.xiao.custom.config.client.configuration.ConfigClientProperties.TOKEN_HEADER;\n\n/**\n * @author Dave Syer\n */\n@Order(0)\npublic class ConfigServicePropertySourceLocator implements PropertySourceLocator\n{\n\n private static final String LOCAL_HOST = \"ClientServerHost\";\n private static final String LOCAL_PORT = \"ClientServerPort\";\n\n private static Log logger = LogFactory.getLog(ConfigServicePropertySourceLocator.class);\n\n private RestTemplate restTemplate;\n private ConfigClientProperties defaultProperties;\n\n public ConfigServicePropertySourceLocator(ConfigClientProperties defaultProperties)\n {\n this.defaultProperties = defaultProperties;\n }\n\n @Override\n @Retryable(interceptor = \"configServerRetryInterceptor\")\n public org.springframework.core.env.PropertySource locate(org.springframework.core.env.Environment environment)\n {\n ConfigClientProperties properties = this.defaultProperties.override(environment);\n CompositePropertySource composite = new CompositePropertySource(\"configService\");\n RestTemplate restTemplate = this.restTemplate == null ? getSecureRestTemplate(properties) : this.restTemplate;\n Exception error = null;\n String errorBody = null;\n logger.info(\"Fetching config from server at: \" + properties.getRawUri());\n try\n {\n String[] labels = new String[] { \"\" };\n if (StringUtils.hasText(properties.getLabel()))\n {\n labels = StringUtils.commaDelimitedListToStringArray(properties.getLabel());\n }\n\n String state = ConfigClientStateHolder.getState();\n\n // Try all the labels until one works\n for (String label : labels)\n {\n Environment result = getRemoteEnvironment(restTemplate, properties, label.trim(), state);\n if (result != null)\n {\n logger.info(String\n .format(\"Located environment: name=%s, profiles=%s, label=%s, version=%s, state=%s\", result\n .getName(),\n result.getProfiles() == null ? \"\" : Arrays.asList(result.getProfiles()), result\n .getLabel(), result.getVersion(), result.getState()));\n\n if (result.getPropertySources() != null)\n { // result.getPropertySources() can be null if using xml\n for (PropertySource source : result.getPropertySources())\n {\n @SuppressWarnings(\"unchecked\") Map map = (Map) source\n .getSource();\n composite.addPropertySource(new MapPropertySource(source.getName(), map));\n }\n }\n\n if (StringUtils.hasText(result.getState()) || StringUtils.hasText(result.getVersion()))\n {\n HashMap map = new HashMap<>();\n putValue(map, \"config.client.state\", result.getState());\n putValue(map, \"config.client.version\", result.getVersion());\n composite.addFirstPropertySource(new MapPropertySource(\"configClient\", map));\n }\n return composite;\n }\n }\n }\n catch (HttpServerErrorException e)\n {\n error = e;\n if (MediaType.APPLICATION_JSON.includes(e.getResponseHeaders().getContentType()))\n {\n errorBody = e.getResponseBodyAsString();\n }\n }\n catch (Exception e)\n {\n error = e;\n }\n if (properties.isFailFast())\n {\n throw new IllegalStateException(\"Could not locate PropertySource and the fail fast property is set, failing\", error);\n }\n logger.warn(\"Could not locate PropertySource: \" + (errorBody == null ?\n error == null ? \"label not found\" : error.getMessage() :\n errorBody));\n return null;\n\n }\n\n private void putValue(HashMap map, String key, String value)\n {\n if (StringUtils.hasText(value))\n {\n map.put(key, value);\n }\n }\n\n private Environment getRemoteEnvironment(RestTemplate restTemplate, ConfigClientProperties properties, String label,\n String state)\n {\n String path = \"/{name}/{profile}\";\n String name = properties.getName();\n String profile = properties.getProfile();\n String token = properties.getToken();\n String uri = properties.getRawUri();\n\n Object[] args = new String[] { name, profile };\n if (StringUtils.hasText(label))\n {\n args = new String[] { name, profile, label };\n path = path + \"/{label}\";\n }\n ResponseEntity response = null;\n\n try\n {\n HttpHeaders headers = new HttpHeaders();\n if (StringUtils.hasText(token))\n {\n headers.add(TOKEN_HEADER, token);\n }\n if (StringUtils.hasText(state))\n { //TODO: opt in to sending state?\n headers.add(STATE_HEADER, state);\n }\n final HttpEntity entity = new HttpEntity<>((Void) null, headers);\n response = restTemplate.exchange(uri + path, HttpMethod.GET, entity, Environment.class, args);\n }\n catch (HttpClientErrorException e)\n {\n if (e.getStatusCode() != HttpStatus.NOT_FOUND)\n {\n throw e;\n }\n }\n\n if (response == null || response.getStatusCode() != HttpStatus.OK)\n {\n return null;\n }\n Environment result = response.getBody();\n return result;\n }\n\n public void setRestTemplate(RestTemplate restTemplate)\n {\n this.restTemplate = restTemplate;\n }\n\n private RestTemplate getSecureRestTemplate(ConfigClientProperties client)\n {\n SimpleClientHttpRequestFactory requestFactory = new SimpleClientHttpRequestFactory();\n requestFactory.setReadTimeout((60 * 1000 * 3) + 5000); //TODO 3m5s, make configurable?\n RestTemplate template = new RestTemplate(requestFactory);\n String password = client.getPassword();\n String authorization = client.getAuthorization();\n\n if (password != null && authorization != null)\n {\n throw new IllegalStateException(\"You must set either 'password' or 'authorization'\");\n }\n\n if (password != null)\n {\n template.setInterceptors(Arrays.asList(new BasicAuthorizationInterceptor(client\n .getUsername(), password)));\n }\n else if (authorization != null)\n {\n template.setInterceptors(Arrays.asList(new GenericAuthorization(authorization)));\n }\n // 自定义 http header\n template.setInterceptors(Arrays\n .asList((ClientHttpRequestInterceptor) (httpRequest, bytes, clientHttpRequestExecution) ->\n {\n HttpHeaders headers = httpRequest.getHeaders();\n // TODO 通过netty交互，上报客户端 服务IP和端口号\n headers.add(LOCAL_PORT, client.getServerPort() + \"\");\n headers.add(LOCAL_HOST, RemotingUtil.getLocalHost());\n return clientHttpRequestExecution.execute(httpRequest, bytes);\n }));\n\n return template;\n }\n\n private static class BasicAuthorizationInterceptor implements ClientHttpRequestInterceptor\n {\n\n private final String username;\n\n private final String password;\n\n public BasicAuthorizationInterceptor(String username, String password)\n {\n this.username = username;\n this.password = (password == null ? \"\" : password);\n }\n\n @Override\n public ClientHttpResponse intercept(HttpRequest request, byte[] body, ClientHttpRequestExecution execution)\n throws IOException\n {\n byte[] token = Base64Utils.encode((this.username + \":\" + this.password).getBytes());\n request.getHeaders().add(\"Authorization\", \"Basic \" + new String(token));\n return execution.execute(request, body);\n }\n\n }\n\n private static class GenericAuthorization implements ClientHttpRequestInterceptor\n {\n\n private final String authorizationToken;\n\n public GenericAuthorization(String authorizationToken)\n {\n this.authorizationToken = (authorizationToken == null ? \"\" : authorizationToken);\n }\n\n @Override\n public ClientHttpResponse intercept(HttpRequest request, byte[] body, ClientHttpRequestExecution execution)\n throws IOException\n {\n request.getHeaders().add(\"Authorization\", authorizationToken);\n return execution.execute(request, body);\n }\n }\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/DiscoveryClientConfigServiceBootstrapConfiguration.java",
"content": "/*\n * Copyright 2013-2014 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport org.apache.commons.logging.Log;\nimport org.apache.commons.logging.LogFactory;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.boot.autoconfigure.condition.ConditionalOnProperty;\nimport org.springframework.cloud.client.ServiceInstance;\nimport org.springframework.cloud.client.discovery.DiscoveryClient;\nimport org.springframework.cloud.client.discovery.EnableDiscoveryClient;\nimport org.springframework.cloud.client.discovery.event.HeartbeatEvent;\nimport org.springframework.cloud.client.discovery.event.HeartbeatMonitor;\nimport org.springframework.cloud.commons.util.UtilAutoConfiguration;\nimport org.springframework.context.annotation.Configuration;\nimport org.springframework.context.annotation.Import;\nimport org.springframework.context.event.ContextRefreshedEvent;\nimport org.springframework.context.event.EventListener;\n\nimport java.util.List;\n\n/**\n * Bootstrap configuration for a config client that wants to lookup the config server via\n * discovery.\n *\n * @author Dave Syer\n */\n@ConditionalOnProperty(value = \"spring.cloud.config.discovery.enabled\", matchIfMissing = false)\n@Configuration\n@Import({ UtilAutoConfiguration.class })\n@EnableDiscoveryClient\npublic class DiscoveryClientConfigServiceBootstrapConfiguration\n{\n\n private static Log logger = LogFactory.getLog(DiscoveryClientConfigServiceBootstrapConfiguration.class);\n\n @Autowired\n private ConfigClientProperties config;\n\n @Autowired\n private DiscoveryClient client;\n\n private HeartbeatMonitor monitor = new HeartbeatMonitor();\n\n @EventListener(ContextRefreshedEvent.class)\n public void startup(ContextRefreshedEvent event)\n {\n refresh();\n }\n\n @EventListener(HeartbeatEvent.class)\n public void heartbeat(HeartbeatEvent event)\n {\n if (monitor.update(event.getValue()))\n {\n refresh();\n }\n }\n\n private void refresh()\n {\n try\n {\n logger.debug(\"Locating configserver via discovery\");\n String serviceId = this.config.getDiscovery().getServiceId();\n List instances = this.client.getInstances(serviceId);\n if (instances.isEmpty())\n {\n logger.warn(\"No instances found of configserver (\" + serviceId + \")\");\n return;\n }\n ServiceInstance server = instances.get(0);\n String url = getHomePage(server);\n if (server.getMetadata().containsKey(\"password\"))\n {\n String user = server.getMetadata().get(\"user\");\n user = user == null ? \"user\" : user;\n this.config.setUsername(user);\n String password = server.getMetadata().get(\"password\");\n this.config.setPassword(password);\n }\n if (server.getMetadata().containsKey(\"configPath\"))\n {\n String path = server.getMetadata().get(\"configPath\");\n if (url.endsWith(\"/\") && path.startsWith(\"/\"))\n {\n url = url.substring(0, url.length() - 1);\n }\n url = url + path;\n }\n this.config.setUri(url);\n }\n catch (Exception ex)\n {\n logger.warn(\"Could not locate configserver via discovery\", ex);\n }\n }\n\n private String getHomePage(ServiceInstance server)\n {\n return server.getUri().toString() + \"/\";\n }\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/configuration/RetryProperties.java",
"content": "/*\n * Copyright 2014-2015 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.configuration;\n\nimport org.springframework.boot.context.properties.ConfigurationProperties;\n\n/**\n * @author Dave Syer\n *\n */\n@ConfigurationProperties(\"spring.cloud.config.retry\")\npublic class RetryProperties {\n\n\t/**\n\t * Initial retry interval in milliseconds.\n\t */\n\tlong initialInterval = 1000;\n\t/**\n\t * Multiplier for next interval.\n\t */\n\tdouble multiplier = 1.1;\n\t/**\n\t * Maximum interval for backoff.\n\t */\n\tlong maxInterval = 2000;\n\t/**\n\t * Maximum number of attempts.\n\t */\n\tint maxAttempts = 6;\n\n\tpublic long getInitialInterval() {\n\t\treturn this.initialInterval;\n\t}\n\n\tpublic void setInitialInterval(long initialInterval) {\n\t\tthis.initialInterval = initialInterval;\n\t}\n\n\tpublic double getMultiplier() {\n\t\treturn this.multiplier;\n\t}\n\n\tpublic void setMultiplier(double multiplier) {\n\t\tthis.multiplier = multiplier;\n\t}\n\n\tpublic long getMaxInterval() {\n\t\treturn this.maxInterval;\n\t}\n\n\tpublic void setMaxInterval(long maxInterval) {\n\t\tthis.maxInterval = maxInterval;\n\t}\n\n\tpublic int getMaxAttempts() {\n\t\treturn this.maxAttempts;\n\t}\n\n\tpublic void setMaxAttempts(int maxAttempts) {\n\t\tthis.maxAttempts = maxAttempts;\n\t}\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/environment/Environment.java",
"content": "/*\n * Copyright 2013-2015 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.environment;\n\nimport com.fasterxml.jackson.annotation.JsonCreator;\nimport com.fasterxml.jackson.annotation.JsonProperty;\n\nimport java.util.ArrayList;\nimport java.util.Arrays;\nimport java.util.List;\n\n/**\n * Simple plain text serializable encapsulation of a list of property sources. Basically a\n * DTO for {@link org.springframework.core.env.Environment}, but also applicable outside\n * the domain of a Spring application.\n *\n * @author Dave Syer\n * @author Spencer Gibb\n *\n */\npublic class Environment {\n\n\tprivate String name;\n\n\tprivate String[] profiles = new String[0];\n\n\tprivate String label;\n\n\tprivate List propertySources = new ArrayList<>();\n\n\tprivate String version;\n\n\tprivate String state;\n\n\tpublic Environment(String name, String... profiles) {\n\t\tthis(name, profiles, \"master\", null, null);\n\t}\n\n\t/**\n\t * Copies all fields except propertySources\n\t * @param env\n\t */\n\tpublic Environment(Environment env) {\n\t\tthis(env.getName(), env.getProfiles(), env.getLabel(), env.getVersion(), env.getState());\n\t}\n\n\t@JsonCreator\n\tpublic Environment(@JsonProperty(\"name\") String name,\n\t\t\t@JsonProperty(\"profiles\") String[] profiles,\n\t\t\t@JsonProperty(\"label\") String label,\n\t\t\t@JsonProperty(\"version\") String version,\n\t\t\t@JsonProperty(\"state\") String state) {\n\t\tsuper();\n\t\tthis.name = name;\n\t\tthis.profiles = profiles;\n\t\tthis.label = label;\n\t\tthis.version = version;\n\t\tthis.state = state;\n\t}\n\n\tpublic void add(PropertySource propertySource) {\n\t\tthis.propertySources.add(propertySource);\n\t}\n\n\tpublic void addAll(List propertySources) {\n\t\tthis.propertySources.addAll(propertySources);\n\t}\n\n\tpublic void addFirst(PropertySource propertySource) {\n\t\tthis.propertySources.add(0, propertySource);\n\t}\n\n\tpublic List getPropertySources() {\n\t\treturn propertySources;\n\t}\n\n\tpublic String getName() {\n\t\treturn name;\n\t}\n\n\tpublic void setName(String name) {\n\t\tthis.name = name;\n\t}\n\n\tpublic String getLabel() {\n\t\treturn label;\n\t}\n\n\tpublic void setLabel(String label) {\n\t\tthis.label = label;\n\t}\n\n\tpublic String[] getProfiles() {\n\t\treturn profiles;\n\t}\n\n\tpublic void setProfiles(String[] profiles) {\n\t\tthis.profiles = profiles;\n\t}\n\n\tpublic String getVersion() {\n\t\treturn version;\n\t}\n\n\tpublic void setVersion(String version) {\n\t\tthis.version = version;\n\t}\n\n\tpublic String getState() {\n\t\treturn state;\n\t}\n\n\tpublic void setState(String state) {\n\t\tthis.state = state;\n\t}\n\n\t@Override\n\tpublic String toString() {\n\t\treturn \"Environment [name=\" + name + \", profiles=\" + Arrays.asList(profiles)\n\t\t\t\t+ \", label=\" + label + \", propertySources=\" + propertySources\n\t\t\t\t+ \", version=\" + version\n\t\t\t\t+ \", state=\" + state + \"]\";\n\t}\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/environment/PropertySource.java",
"content": "/*\n * Copyright 2013-2014 the original author or authors.\n *\n * Licensed under the Apache License, Version 2.0 (the \"License\");\n * you may not use this file except in compliance with the License.\n * You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the License.\n */\n\npackage com.xiao.custom.config.client.environment;\n\nimport com.fasterxml.jackson.annotation.JsonCreator;\nimport com.fasterxml.jackson.annotation.JsonProperty;\n\nimport java.util.Map;\n\n/**\n * Simple plain text serializable encapsulation of a named source of key-value pairs.\n * Basically a DTO for {@link PropertySource}, but also applicable outside the domain of a\n * Spring application.\n * \n * @author Dave Syer\n *\n */\npublic class PropertySource {\n\n\tprivate String name;\n\n\tprivate Map source;\n\n\t@JsonCreator\n\tpublic PropertySource(@JsonProperty(\"name\") String name,\n\t\t\t@JsonProperty(\"source\") Map source) {\n\t\tthis.name = name;\n\t\tthis.source = source;\n\t}\n\n\tpublic String getName() {\n\t\treturn name;\n\t}\n\n\tpublic Map getSource() {\n\t\treturn source;\n\t}\n\n\t@Override\n\tpublic String toString() {\n\t\treturn \"PropertySource [name=\" + name + \"]\";\n\t}\n\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/netty/client/NettyClient.java",
"content": "package com.xiao.custom.config.client.netty.client;\n\nimport com.xiao.custom.config.client.configuration.ConfigClientProperties;\nimport com.xiao.custom.config.client.netty.dto.CommandEnum;\nimport com.xiao.custom.config.client.netty.dto.Message;\nimport com.xiao.custom.config.client.netty.factory.CoderFactory;\nimport com.xiao.custom.config.client.netty.factory.NamedThreadFactory;\nimport com.xiao.custom.config.client.netty.handler.ServiceHandler;\nimport com.xiao.custom.config.client.netty.util.RemotingUtil;\nimport io.netty.bootstrap.Bootstrap;\nimport io.netty.channel.*;\nimport io.netty.channel.nio.NioEventLoopGroup;\nimport io.netty.channel.socket.nio.NioSocketChannel;\nimport io.netty.handler.timeout.IdleStateHandler;\nimport lombok.extern.slf4j.Slf4j;\nimport org.springframework.beans.factory.DisposableBean;\nimport org.springframework.beans.factory.annotation.Autowired;\nimport org.springframework.cloud.context.refresh.ContextRefresher;\nimport org.springframework.context.ApplicationListener;\nimport org.springframework.context.event.ContextRefreshedEvent;\n\nimport javax.annotation.Resource;\nimport java.net.MalformedURLException;\nimport java.net.URL;\nimport java.util.concurrent.ScheduledExecutorService;\nimport java.util.concurrent.ScheduledThreadPoolExecutor;\nimport java.util.concurrent.TimeUnit;\nimport java.util.concurrent.atomic.AtomicBoolean;\n\n/**\n * [简要描述]: netty客户端\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/30 16:42\n * @since JDK 1.8\n */\n@Slf4j\npublic class NettyClient implements ApplicationListener, DisposableBean\n{\n private String nettyServerHost = \"localhost\";\n private int nettyServerPort = 8999;\n\n private AtomicBoolean started = new AtomicBoolean(false);\n\n /**\n * 重连检测任务\n */\n private ScheduledExecutorService reConnectExecutor;\n\n @Resource\n private ConfigClientProperties configClientProperties;\n\n @Autowired\n private ContextRefresher refresher;\n\n private Bootstrap boot;\n\n private Channel channel;\n\n public NettyClient()\n {\n log.info(\">>> 初始化netty 客户端......\");\n }\n\n @Override\n public void destroy() throws Exception\n {\n }\n\n @Override\n public void onApplicationEvent(ContextRefreshedEvent contextRefreshedEvent)\n {\n //是否使用自定义配置中心\n if (!started.get() && configClientProperties.isCustom())\n {\n log.info(\">>> 配置中心服务地址:{}\", configClientProperties.getUri());\n nettyServerHost = parseHost(configClientProperties.getUri());\n nettyServerPort = configClientProperties.getNettyPort();\n init();\n connect();\n //2分钟检测一次连接情况\n reConnectExecutor.scheduleAtFixedRate((Runnable) () -> check(), 1, 2, TimeUnit.MINUTES);\n }\n }\n\n /**\n * [简要描述]:发送消息()\n {\n @Override\n protected void initChannel(Channel channel) throws Exception\n {\n ChannelPipeline pipeline = channel.pipeline();\n //监听读写动作，10S后无服务器响应信息，4S后无客户端写动作，触发userEventTriggered发起心跳\n pipeline.addLast(new IdleStateHandler(10, 4, 0));\n\n //先解码 后编码\n pipeline.addLast(CoderFactory.newDecoder());\n pipeline.addLast(CoderFactory.newEncoder());\n\n //业务处理\n pipeline.addLast(new ServiceHandler(started, refresher));\n }\n });\n }\n\n private void connect()\n {\n log.info(\">>> 客户端建立netty 连接，服务端-IP:{},Port:{}....\", nettyServerHost, nettyServerPort);\n try\n {\n final ChannelFuture sync = boot.connect(nettyServerHost, nettyServerPort).sync();\n channel = sync.channel();\n started.set(sync.isSuccess());\n login();\n }\n catch (Exception e)\n {\n log.error(\">>> 连接服务端异常，等待重连....\", e);\n }\n }\n\n private void check()\n {\n\n if (log.isDebugEnabled())\n {\n log.debug(\">>> 执行检测任务.....\");\n }\n\n if (!started.get())\n {\n log.info(\">>> 执行客户端重连操作...\");\n connect();\n\n if (started.get())\n {\n //重连成功后再次刷新下配置文件\n refresher.refresh();\n }\n\n }\n\n }\n}\n"
},
{
"path": "SpringCloud-Custom-ConfigCenter/custom-config-client/src/main/java/com/xiao/custom/config/client/netty/coder/ProtoDecoder.java",
"content": "package com.xiao.custom.config.client.netty.coder;\n\nimport com.xiao.custom.config.client.netty.util.ProtostuffUtil;\nimport io.netty.buffer.ByteBuf;\nimport io.netty.channel.ChannelHandlerContext;\nimport io.netty.handler.codec.ByteToMessageDecoder;\n\nimport java.util.List;\n\n/**\n * [简要描述]: 编码\n * [详细描述]:\n *\n * @author llxiao\n * @version 1.0, 2019/3/30 13:54\n * @since JDK 1.8\n */\npublic class ProtoDecoder extends ByteToMessageDecoder\n{\n private static final int PROTO_BUFF_FLAG = 4;\n\n private Class genericClass;\n\n public ProtoDecoder(Class cls)\n {\n this.genericClass = cls;\n }\n\n @Override\n protected void decode(ChannelHandlerContext ctx, ByteBuf byteBuf, List