Welcome to the Linux Foundation Forum!
Zeek to CSV bash script help
Options
dxw350
Posts: 1
in Command Line
I am trying to work with a script that was on github - but I am having problems with it. Does anyone see anything wrong with 1) my replacement for FILEPATH and OUTPATH from 2) the template?
1) MY VARIABLE Edits to the template in #2 below
!/bin/bash
bro_in_data=/"path_to_the_input_logs_directory"/ #path to input logs directory
bro_out_csv=/"path_to_the_output_logs_directory"/ #path to output logs directory
echo "Transforming to csv ..."
for log in $(ls $bro_in_data); do
FILEIN=$bro_in_data$log FILEOUT=$bro_out_csv$log # -d option in zeek-cut convert time values into # human-readable format. %Y-%m-%dTH%:%M:%S cat $FILEIN | zeek-cut -c -d > $FILEOUT # If you don´t want to use zeek-cut, comment the line above # and uncomment the line below #sed -i '$d' $FILEOUT # Remove line 8 sed -i '8d' $FILEOUT # Remove lines 1 to 6 sed -i '1,6d' $FILEOUT # Delete #fields sed -i 's/#fields\t//' $FILEOUT # Replace '\t' with ',' sed -i 's/\t/,/g' $FILEOUT
done
echo "Done"
2) TEMPLATE
!/bin/bash
FILEPATH=/"path_to_the_input_logs_directory"/ #path to input logs directory
OUTPATH=/"path_to_the_output_logs_directory"/ #path to output logs directory
echo "Transforming to csv ..."
for log in $(ls $FILEPATH); do
FILEIN=$FILEPATH$log FILEOUT=$OUTPATH$log # -d option in zeek-cut convert time values into # human-readable format. %Y-%m-%dTH%:%M:%S cat $FILEIN | zeek-cut -c -d > $FILEOUT # If you don´t want to use zeek-cut, comment the line above # and uncomment the line below #sed -i '$d' $FILEOUT # Remove line 8 sed -i '8d' $FILEOUT # Remove lines 1 to 6 sed -i '1,6d' $FILEOUT # Delete #fields sed -i 's/#fields\t//' $FILEOUT # Replace '\t' with ',' sed -i 's/\t/,/g' $FILEOUT
done
echo "Done"
0
Categories
- All Categories
- 64 LFX Mentorship
- 117 LFX Mentorship: Linux Kernel
- 618 Linux Foundation IT Professional Programs
- 322 Cloud Engineer IT Professional Program
- 141 Advanced Cloud Engineer IT Professional Program
- 56 DevOps Engineer IT Professional Program
- 67 Cloud Native Developer IT Professional Program
- 6 Express Training Courses
- 6 Express Courses - Discussion Forum
- 2.4K Training Courses
- 19 LFC110 Class Forum - Discontinued
- 9 LFC131 Class Forum
- 31 LFD102 Class Forum
- 178 LFD103 Class Forum
- LFD110 Class Forum
- 24 LFD121 Class Forum
- LFD133 Class Forum
- 2 LFD137 Class Forum
- 62 LFD201 Class Forum
- 2 LFD210 Class Forum
- 1 LFD210-CN Class Forum
- 1 LFD213 Class Forum - Discontinued
- 128 LFD232 Class Forum - Discontinued
- LFD233 Class Forum
- LFD237 Class Forum
- 23 LFD254 Class Forum
- 660 LFD259 Class Forum
- 108 LFD272 Class Forum
- 1 LFD272-JP クラス フォーラム
- 4 LFD273 Class Forum
- 1 LFS101 Class Forum
- LFS116 Class Forum
- 2 LFS145 Class Forum
- LFS151 Class Forum
- LFS158 Class Forum
- LFS167 Class Forum
- 28 LFS200 Class Forum
- 740 LFS201 Class Forum - Discontinued
- 1 LFS201-JP クラス フォーラム
- 13 LFS203 Class Forum
- 98 LFS207 Class Forum
- 301 LFS211 Class Forum
- 54 LFS216 Class Forum
- 47 LFS241 Class Forum
- 41 LFS242 Class Forum
- 38 LFS243 Class Forum
- 12 LFS244 Class Forum
- LFS245 Class Forum
- 41 LFS250 Class Forum
- 1 LFS250-JP クラス フォーラム
- LFS251 Class Forum
- 143 LFS253 Class Forum
- LFS254 Class Forum
- LFS255 Class Forum
- 2 LFS256 Class Forum
- LFS257 Class Forum
- 1.2K LFS258 Class Forum
- 10 LFS258-JP クラス フォーラム
- 109 LFS260 Class Forum
- 147 LFS261 Class Forum
- 39 LFS262 Class Forum
- 83 LFS263 Class Forum - Discontinued
- 15 LFS264 Class Forum - Discontinued
- 11 LFS266 Class Forum - Discontinued
- 21 LFS267 Class Forum
- 18 LFS268 Class Forum
- 26 LFS269 Class Forum
- 204 LFS272 Class Forum
- 1 LFS272-JP クラス フォーラム
- LFS274 Class Forum
- 3 LFS281 Class Forum
- 258 LFW211 Class Forum
- 179 LFW212 Class Forum
- 9 SKF100 Class Forum
- SKF200 Class Forum
- 908 Hardware
- 221 Drivers
- 74 I/O Devices
- 44 Monitors
- 116 Multimedia
- 210 Networking
- 102 Printers & Scanners
- 86 Storage
- 765 Linux Distributions
- 88 Debian
- 66 Fedora
- 15 Linux Mint
- 13 Mageia
- 24 openSUSE
- 144 Red Hat Enterprise
- 33 Slackware
- 13 SUSE Enterprise
- 357 Ubuntu
- 484 Linux System Administration
- 40 Cloud Computing
- 71 Command Line/Scripting
- Github systems admin projects
- 95 Linux Security
- 80 Network Management
- 108 System Management
- 52 Web Management
- 75 Mobile Computing
- 25 Android
- 35 Development
- 1.2K New to Linux
- 1.1K Getting Started with Linux
- 544 Off Topic
- 131 Introductions
- 223 Small Talk
- 22 Study Material
- 836 Programming and Development
- 285 Kernel Development
- 517 Software Development
- 975 Software
- 261 Applications
- 185 Command Line
- 3 Compiling/Installing
- 119 Games
- 318 Installation
- 65 All In Program
- 65 All In Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)