Welcome to the Linux Foundation Forum!
Zeek to CSV bash script help
dxw350
Posts: 1
in Command Line
I am trying to work with a script that was on github - but I am having problems with it. Does anyone see anything wrong with 1) my replacement for FILEPATH and OUTPATH from 2) the template?
1) MY VARIABLE Edits to the template in #2 below
!/bin/bash
bro_in_data=/"path_to_the_input_logs_directory"/ #path to input logs directory
bro_out_csv=/"path_to_the_output_logs_directory"/ #path to output logs directory
echo "Transforming to csv ..."
for log in $(ls $bro_in_data); do
FILEIN=$bro_in_data$log FILEOUT=$bro_out_csv$log # -d option in zeek-cut convert time values into # human-readable format. %Y-%m-%dTH%:%M:%S cat $FILEIN | zeek-cut -c -d > $FILEOUT # If you don´t want to use zeek-cut, comment the line above # and uncomment the line below #sed -i '$d' $FILEOUT # Remove line 8 sed -i '8d' $FILEOUT # Remove lines 1 to 6 sed -i '1,6d' $FILEOUT # Delete #fields sed -i 's/#fields\t//' $FILEOUT # Replace '\t' with ',' sed -i 's/\t/,/g' $FILEOUT
done
echo "Done"
2) TEMPLATE
!/bin/bash
FILEPATH=/"path_to_the_input_logs_directory"/ #path to input logs directory
OUTPATH=/"path_to_the_output_logs_directory"/ #path to output logs directory
echo "Transforming to csv ..."
for log in $(ls $FILEPATH); do
FILEIN=$FILEPATH$log FILEOUT=$OUTPATH$log # -d option in zeek-cut convert time values into # human-readable format. %Y-%m-%dTH%:%M:%S cat $FILEIN | zeek-cut -c -d > $FILEOUT # If you don´t want to use zeek-cut, comment the line above # and uncomment the line below #sed -i '$d' $FILEOUT # Remove line 8 sed -i '8d' $FILEOUT # Remove lines 1 to 6 sed -i '1,6d' $FILEOUT # Delete #fields sed -i 's/#fields\t//' $FILEOUT # Replace '\t' with ',' sed -i 's/\t/,/g' $FILEOUT
done
echo "Done"
0
Categories
- All Categories
- 177 LFX Mentorship
- 177 LFX Mentorship: Linux Kernel
- 765 Linux Foundation IT Professional Programs
- 377 Cloud Engineer IT Professional Program
- 174 Advanced Cloud Engineer IT Professional Program
- 75 DevOps IT Professional Program - Discontinued
- 7 DevOps & GitOps IT Professional Program
- 101 Cloud Native Developer IT Professional Program
- 7.6K Training Courses & Learning Paths
- 3 AI & ML Training
- 1 Blockchain & Decentralized Identity Training
- 10 Cloud & Containers Training
- 1 Cybersecurity Training
- 2 DevOps & Site-Reliability Training
- 1 Linux Kernel Development Training
- 1 Networking Training
- 2 Open Source Best Practice Training
- 2 System Administration Training
- 1 System Engineering Training
- 1 Web & Application Development Training
- 796 Hardware
- 202 Drivers
- 68 I/O Devices
- 37 Monitors
- 95 Multimedia
- 173 Networking
- 91 Printers & Scanners
- 91 Storage
- 770 Linux Distributions
- 81 Debian
- 68 Fedora
- 23 Linux Mint
- 13 Mageia
- 24 openSUSE
- 150 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 465 Linux System Administration
- 31 Cloud Computing
- 73 Command Line/Scripting
- Github systems admin projects
- 98 Linux Security
- 78 Network Management
- 101 System Management
- 46 Web Management
- 115 Mobile Computing
- 20 Android
- 80 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 395 Off Topic
- 121 Introductions
- 30 Study Material
- 989 Programming and Development
- 310 Kernel Development
- 661 Software Development
- 1K Software
- 394 Applications
- 182 Command Line
- 5 Compiling/Installing
- 69 Games
- 318 Installation
- Archived
- 183 Small Talk
- 2 LFD140 Class Forum
- 1.4K LFS258 Class Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)