- 1.首先下載下傳logstash window版
官網最新版本:https://artifacts.elastic.co/downloads/logstash/logstash-7.5.1.zip
- 2.解壓
- 3.配置問價
建立一個my-link的檔案夾
下載下傳下面的驅動放到該目錄下
連結:https://pan.baidu.com/s/1Epgbk53Gbgba8g066hHzQw
提取碼:4gec
在建立一個sqlserver-es.conf檔案,檔案内容如下,根據自己的實際情況來改變
input {
jdbc {
jdbc_driver_library => "E:/logstash/logstash-6.8.3/my-link/sqljdbc4.jar"
jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
jdbc_connection_string => "jdbc:sqlserver://192.168.1.211:1433;databaseName=zljdpt-xfp;"
jdbc_user => "sa"
jdbc_password => "zcy123456.."
jdbc_default_timezone => "Asia/Shanghai"
jdbc_paging_enabled => "true"
record_last_run => true
use_column_value => true
tracking_column => "xgsj"
tracking_column_type => "timestamp"
last_run_metadata_path => "E:/logstash/logstash-6.8.3/my-link/consumer_statistics_xgsj"
clean_run => false
statement => "SELECT * FROM v_test WHERE xgsj>:sql_last_value and xgsj<GETDATE() "
schedule => "*/5 * * * * *"
}
}
filter {
if ![shzt]{ruby{code =>'event.set("shzt","")'}}
if ![xfbj]{ruby{code =>'event.set("xfbj","")'}}
if ![jb]{ruby{code =>'event.set("jb","")'}}
if ![tjjb]{ruby{code =>'event.set("tjjb","")'}}
if "," in [jyfsdm]{
ruby{
code =>
'
jyfsdm=event.get("jyfsdm")
jyfsdmSplit=jyfsdm.split(",")
jyfsdmUniq=jyfsdmSplit.uniq
jyfsdmLength=jyfsdmUniq.length
jyfsdmLengthFinaly=jyfsdmLength-1
jyfsdmFinaly=""
for i in 0..jyfsdmLengthFinaly
jyfsdmFinaly=jyfsdmFinaly+jyfsdmUniq[i]+" "
end
event.set("jyfsdm",jyfsdmFinaly)
'
}
}
if "," in [cpdm]{
ruby{
code =>
'
cpdm=event.get("cpdm")
cpdmSplit=cpdm.split(",")
cpdmUniq=cpdmSplit.uniq
cpdmLength=cpdmUniq.length
cpdmLengthFinaly=cpdmLength-1
cpdmFinaly=""
for i in 0..cpdmLengthFinaly
cpdmFinaly=cpdmFinaly+cpdmUniq[i]+" "
end
event.set("cpdm",cpdmFinaly)
'
}
}
mutate{
convert => { "entid" => "integer" }
remove_field => ["@timestamp"]
remove_field => ["@version"]
}
}
output {
elasticsearch {
hosts => ["192.168.1.211:9200"]
index => "consumer_statistics"
document_id => "%{entid}"
document_type => "consumer_statistics"
template_name => "consumer_statistics"
}
}
- 4. 然後在在桌面建立一個txt檔案
内容如下:
E:
cd E:\logstash\logstash-6.8.3\bin
logstash.bat -f E:\logstash\logstash-6.8.3\my-link\sqlserver-es.conf
到這裡logstash就安裝完成了,啟動之前先啟動es資料庫,搞定
- 5 浏覽器通路:http://localhost:9600/
