what is the best way to parsing the logs for .log and .json format

Question

i am planning to prepare the one pipeline for different logs formatting.

1. .json format
2. .log format these are two type of logs which i need to create filter and grok patterns. what is the good ways please suggest.

i tried to follow the

filter 
{
    codec = json
    source = "message" 
}

but when i am trying to filter the .log format logstash is not going filter those except plain text.

Answer 1

The best way is to separate the different log types to different logstash pipelines, in this way you have more control on filtering.

Here you can find the documentation on creating multiple pipelines: https://www.elastic.co/guide/en/logstash/current/multiple-pipelines.html