使用logstash迁移ES集群遇到问题

作者: Freg | 发布时间:2020-09-02 10:48 | 阅读数: 80

```java
input {
  elasticsearch {
    hosts => ["****", "
****", "****"]
    index => "indexname"
    user => "username"
    password => "password"
    size => 1000
    scroll => "5m"
    docinfo => true
  }
}
filter {
  mutate {
    remove_field => ["@timestamp", "@version"]
  }
}
output {
  elasticsearch {
    hosts => [ "****", "****", "****" ]
    user => "username"
    password => "password"
    index => "%{[@metadata][_index]}"
    # document_type => "%{[@metadata][_type]}"
    document_id => "%{[@metadata][_id]}"
  }
}
```
迁移的过程中报了许多如下格式的错误，并且文档数量少了一些

[2020-08-28T11:52:31,708][WARN ][logstash.outputs.elasticsearch] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>"5758291441f
    4ea8d3db34289", :_index=>"indexname", :_type=>"doc", :routing=>nil}, #<LogStash::Event:0x17db4dcc>], :response=>{"index"=>{"_index"=>"indexname", "_
    type"=>"doc", "_id"=>"5758291441f4ea8d3db34289", "status"=>400, "error"=>{"type"=>"illegal_argument_exception", "reason"=>"mapper [weight] cannot be changed f
    rom type [long] to [float]"}}}}

0个回复

匿名用户

发起人

Freg

关注代码社区 :

分享至 :

使用logstash迁移ES集群遇到问题

0个回复

匿名用户

发起人

Freg

关注代码社区 :

相关问题