发表于

The valid characters are defined in RFC 7230 and RFC 3986异常

使用springboot-1.5.2版本服务器tomcat,遇到这个问题我最先百度了下RFC 7230 and RFC 3986的大致内容。有一篇文章叫(http://blog.csdn.net/qq_32010299/article/details/51790407)其中描述到
“RFC3986文档规定，Url中只允许包含英文字母（a-zA-Z）、数字（0-9）、-_.~4个特殊字符以及所有保留字符。”,
完整的异常栈信息

1
2
3
4
5
6
7
8
9
10
11
12
ote: further occurrences of HTTP header parsing errors will be logged at DEBUG level.
java.lang.IllegalArgumentException: Invalid character found in the request target. The valid characters are defined in RFC 7230 and RFC 3986
	at org.apache.coyote.http11.Http11InputBuffer.parseRequestLine(Http11InputBuffer.java:471) ~[tomcat-embed-core-8.5.11.jar:8.5.11]
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:667) ~[tomcat-embed-core-8.5.11.jar:8.5.11]
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) [tomcat-embed-core-8.5.11.jar:8.5.11]
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:798) [tomcat-embed-core-8.5.11.jar:8.5.11]
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1434) [tomcat-embed-core-8.5.11.jar:8.5.11]
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-8.5.11.jar:8.5.11]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_101]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_101]
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-8.5.11.jar:8.5.11]
	at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]

跟进去会发现命中的了org.apache.tomcat.util.http.parser.HttpParser中的IS_NOT_REQUEST_TARGET规则.这个类的部分信息如下:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
/**
 * HTTP header value parser implementation. Parsing HTTP headers as per RFC2616
 * is not always as simple as it first appears. For headers that only use tokens
 * the simple approach will normally be sufficient. However, for the other
 * headers, while simple code meets 99.9% of cases, there are often some edge
 * cases that make things far more complicated.
 *
 * The purpose of this parser is to let the parser worry about the edge cases.
 * It provides tolerant (where safe to do so) parsing of HTTP header values
 * assuming that wrapped header lines have already been unwrapped. (The Tomcat
 * header processing code does the unwrapping.)
 *
 */
public class HttpParser {
    private static final int ARRAY_SIZE = 128;
    private static final boolean[] IS_CONTROL = new boolean[ARRAY_SIZE];
    private static final boolean[] IS_SEPARATOR = new boolean[ARRAY_SIZE];
    private static final boolean[] IS_TOKEN = new boolean[ARRAY_SIZE];
    private static final boolean[] IS_HEX = new boolean[ARRAY_SIZE];
    private static final boolean[] IS_NOT_REQUEST_TARGET = new boolean[ARRAY_SIZE];
    private static final boolean[] IS_HTTP_PROTOCOL = new boolean[ARRAY_SIZE];
    // Not valid for request target.
    // Combination of multiple rules from RFC7230 and RFC 3986. Must be
    // ASCII, no controls plus a few additional characters excluded
    if (IS_CONTROL[i] || i > 127 ||
            i == ' ' || i == '\"' || i == '#' || i == '<' || i == '>' || i == '\\' ||
            i == '^' || i == '`'  || i == '{' || i == '|' || i == '}') {
        IS_NOT_REQUEST_TARGET[i] = true;
    }

结合上面的规则描述可以确定是tomcat做了RFC7230 and RFC 3986安全过滤,排查自己的请求参数发现里面包含了”filterParam={MALL:10073}”非法信息。
到此这个问题排查清楚了,可选方案:

1. 调整tomcat版本(8.0.38–> tomcat 8.5.11这个范围是有这个问题的,其他的版本没有测试不确定没有)
2. 更换服务器,我选择这个方案把服务器更新成了jetty.

以上.

发表于

spring中自动注入前端传递的各种类型的数据list/map/bean/array

在使用springboot开发的过程，如果可以灵活的使用自动注入属性值的方式来获取前端传递的数据可以有效的节约开发时间、规范参数格式。
下面记录我在开发中使用和遇到的问题以及问题的解决办法，不说废话直接上代码：

这种通过设置contentType为application/json类型的方式可以很方便的传递和接受数据，但是弊端是无法在后台通过request.getParameter的方式获取请求数据，代码如下

json类型js
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<%@ page contentType="text/html;charset=UTF-8" language="java" %>
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
    <script type="application/javascript" src="//cdn.bootcss.com/jquery/3.0.0-beta1/jquery.js"></script>
    <script type="application/javascript">
        $(function(){
            var user = {}
            var arr = new Array();
            arr.push(1);
            arr.push(2);
            var map = {a: 123, b:898};
            user.name = "张三";
            user.map = map;
            user.list = arr;
            var data = JSON.stringify(user);
            console.log(data);

            $.ajax({
                type:'POST',
                url:'/bb/aj',
                data:data,
                contentType: 'application/json',
                success:function(data){
                    alert(data)
                }
            })

        })
    </script>
</head>
<body class="showmenu">
travel-web1
</body>
</html>
阅读全文 »

发表于   |   分类于

鸟枪换炮，新换了mac笔记本。配置开发环境配置了两天，在新电脑上使用hexo构建博客的时候执行hexo server报错。错误信息如下：

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
{ Error: Cannot find module './build/Release/DTraceProviderBindings'
    at Function.Module._resolveFilename (module.js:543:15)
    at Function.Module._load (module.js:470:25)
    at Module.require (module.js:593:17)
    at require (internal/module.js:11:18)
    at Object.<anonymous> (/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/node_modules/hexo/node_modules/hexo-log/node_modules/bunyan/node_modules/dtrace-provider/dtrace-provider.js:17:23)
    at Module._compile (module.js:649:30)
    at Object.Module._extensions..js (module.js:660:10)
    at Module.load (module.js:561:32)
    at tryModuleLoad (module.js:501:12)
    at Function.Module._load (module.js:493:3)
    at Module.require (module.js:593:17)
    at require (internal/module.js:11:18)
    at Object.<anonymous> (/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/node_modules/hexo/node_modules/hexo-log/node_modules/bunyan/lib/bunyan.js:79:18)
    at Module._compile (module.js:649:30)
    at Object.Module._extensions..js (module.js:660:10)
    at Module.load (module.js:561:32)
    at tryModuleLoad (module.js:501:12)
    at Function.Module._load (module.js:493:3)
    at Module.require (module.js:593:17)
    at require (internal/module.js:11:18)
    at Object.<anonymous> (/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/node_modules/hexo/node_modules/hexo-log/lib/log.js:3:14)
    at Module._compile (module.js:649:30) code: 'MODULE_NOT_FOUND' }
    { Error: Cannot find module './build/default/DTraceProviderBindings'
        at Function.Module._resolveFilename (module.js:543:15)
        at Function.Module._load (module.js:470:25)
        at Module.require (module.js:593:17)
        at require (internal/module.js:11:18)
        at Object.<anonymous> (/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/node_modules/hexo/node_modules/hexo-log/node_modules/bunyan/node_modules/dtrace-provider/dtrace-provider.js:17:23)
        at Module._compile (module.js:649:30)
        at Object.Module._extensions..js (module.js:660:10)
        at Module.load (module.js:561:32)
        at tryModuleLoad (module.js:501:12)
        at Function.Module._load (module.js:493:3)
        at Module.require (module.js:593:17)
        at require (internal/module.js:11:18)
        at Object.<anonymous> (/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/node_modules/hexo/node_modules/hexo-log/node_modules/bunyan/lib/bunyan.js:79:18)
        at Module._compile (module.js:649:30)
        at Object.Module._extensions..js (module.js:660:10)
        at Module.load (module.js:561:32)
        at tryModuleLoad (module.js:501:12)
        at Function.Module._load (module.js:493:3)
        at Module.require (module.js:593:17)
        at require (internal/module.js:11:18)
        at Object.<anonymous> (/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/node_modules/hexo/node_modules/hexo-log/lib/log.js:3:14)
        at Module._compile (module.js:649:30) code: 'MODULE_NOT_FOUND' }

在百度上搜索了多篇帖子尝试了之后都没有用，执行hexo server还是会报错。解决办法如下：
进入到/Users/brucexie/Documents/work/myspace/gitblog/myGithubBlog/目录，删除node_modules文件夹以及文件夹下面所有的文件，然后执行cnpm（我的hexo是使用淘宝镜像安装的，比原镜像快很多） install就可以解决这个问题了。

发表于

bootstrap日期控件datetimepicker

常用地址

bootstrap静态cdn地址: http://www.bootcdn.cn/
bootstrap中文网: http://www.bootcss.com/
datetimepicker中文: http://www.bootcss.com/p/bootstrap-datetimepicker/index.htm

日期控件的使用

引入资源样式
1
2
3
4
5
6
7
<!-- 最新版本的 Bootstrap 核心 CSS 文件 -->
<link rel="stylesheet" href="//cdn.bootcss.com/bootstrap/3.3.7/css/bootstrap.min.css">
<link rel="stylesheet" href="public/bootstrap/bootstrap-datetimepicker-master/css/bootstrap-datetimepicker.min.css">
<script src="//cdn.bootcss.com/jquery/1.12.4/jquery.min.js"></script>
<!-- 这里为本地资源,可以从datetimepicker官网下载 -->
<script src="public/bootstrap/bootstrap-datetimepicker-master/js/bootstrap-datetimepicker.min.js"></script>
<script src="//cdn.bootcss.com/bootstrap/3.3.7/js/bootstrap.min.js"></script>
阅读全文 »

发表于

mysql快速导出导入大量数据

我的电脑操作系统时ubuntu 16.04,配置是4核16G.
上面装的软件应用除了常用的一些还有:intellij, webstorm, hadoop, zookeeper, cassandra, mysql, canal, nginx, tomcat等应用.
话说一个项目需要导入700w左右的数据,在windows上用navicat导入岁数慢但是还可以看到希望,在ubuntu上到了一天一夜还有三分一没到完因为还有其他表要导入所以决定换方案.

查看数据的存储引擎

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
show engines;
mysql> show engines;
+--------------------+---------+----------------------------------------------------------------+--------------+------+------------+
| Engine             | Support | Comment                                                        | Transactions | XA   | Savepoints |
+--------------------+---------+----------------------------------------------------------------+--------------+------+------------+
| PERFORMANCE_SCHEMA | YES     | Performance Schema                                             | NO           | NO   | NO         |
| CSV                | YES     | CSV storage engine                                             | NO           | NO   | NO         |
| MRG_MYISAM         | YES     | Collection of identical MyISAM tables                          | NO           | NO   | NO         |
| BLACKHOLE          | YES     | /dev/null storage engine (anything you write to it disappears) | NO           | NO   | NO         |
| InnoDB             | DEFAULT | Supports transactions, row-level locking, and foreign keys     | YES          | YES  | YES        |
| MEMORY             | YES     | Hash based, stored in memory, useful for temporary tables      | NO           | NO   | NO         |
| ARCHIVE            | YES     | Archive storage engine                                         | NO           | NO   | NO         |
| MyISAM             | YES     | MyISAM storage engine                                          | NO           | NO   | NO         |
| FEDERATED          | NO      | Federated MySQL storage engine                                 | NULL         | NULL | NULL       |
+--------------------+---------+----------------------------------------------------------------+--------------+------+------------+
阅读全文 »

发表于

spring Boot 热部署

使用spring-boot-devtools配置实现springBoot热部署.

首先引入maven插件

1
2
3
4
5
6
<!-- spring boot热部署 -->
<dependency>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-devtools</artifactId>
    <optional>true</optional>
</dependency>
阅读全文 »

发表于

springBoot 静态资源配置

springBoot这个框架的确不错,可以减少很多配置.下面记录下我做的vr后台系统中使用到的springBoot相关技术点,我也是第一次使用(在摸索中进步).
首先要说的是,springBoot会扫描入口类的同级以及子级package, 我的入口类写法如下

1
2
3
4
5
6
7
8
9
10
11
12
13
/**
 * Created by xiehui1956(@)gmail.com on 16-12-26.
 */
@SpringBootApplication
@EnableTransactionManagement // 开启事务管理
@EnableConfigurationProperties({UserCenterConfig.class, WiselySettings.class})
public class Application {

    public static void main(String[] args) {
        SpringApplication.run(Application.class, args);
    }

}

阅读全文 »

发表于

shell简单实例

这是我看到的一个帖子觉得不错,很入门就保存下来了. 贴主说的很对,所有的大的应用都是由小的模块对记起来的.

模拟linux登录

1
2
3
4
5
6
7
8
9
#!/bin/bash
echo -n "login:"
read name
echo -n "password:"
read passwd
if [ $name = "cht" -a $passwd =  "abc" ]; then
echo "the host and password is reight!"
else echo "input is error!"
fi
阅读全文 »

发表于

结合wireshark分析TCP和三次握手

分析之前首先是安装wireshark,我用的是ubuntu16的系统. wireshark下载地址https://1.na.dl.wireshark.org/src/wireshark-2.2.3.tar.bz2.
安装过程很简单就是./configure && make && make install ,但是这个过程需要花费一点时间.

wireshark是一个网络封包分析软件,可以抓取网络数据包,并详细的显示出来数据包的相关信息. 我用wireshark主要是复习tcp协议流程以及帮助分析http请求信息,当然查看http请求信息这一块使用谷歌浏览器也可以出色的完成.

wireshark的使用

7层模式

启动wireshark,ipconfig查看当前网路入口-选择wireshark监听入口:

阅读全文 »

发表于

java中类和类之间的关系

继承关系

继承关系是一个类(子类)继承另外一个类(父类)的关系,继承后的子类可以增加自己的方法也可以覆盖(重写,此处要和方法重载区别,方法重载是同一个类中方法名相同参数列表不同包括参数的个数/类型/顺序)父类的方法.java中限定只允许单继承使用关键字extends表示,在uml类图设计中使用空心三角箭头的实线表示,从继承类到被继承类.
继承

阅读全文 »