* Scraper functionality
* Handle matched only - case for scraper
* Add scraper output to different formats
* Fix the ancient merge reminders
* Load scraper rules from directory
* Scraper fixes
* Fix ioutil deprecation and use xdg paths instead (wip)
* Clean up deprecated ioutil references, add config directory structure creation and run entry creation
* Add wordlist position setting and FFUFHASH variable
* Save full wordlist paths and print out a raw request when searched
* Cast from string to 32bit integer, 2billion should be enough for a position
* Use correct format strings for float
* Modify SimpleRunner to take a Request parameter, add base and copy functions for Requests
* Add Request structs to run queues
* Implemented sniper mode
* Added request and optionsparser tests for sniper mode
* Removed unneccesary print statements
* Updated readme.md and terminal output
* Enabled command inputs for sniper mode
* correctly initialize validmode in optionsparser
* Remove unnecessary print data in TestScrubTemplates
* Use InputProvider for sniper template characters
* Add a sniper-mode specific queue job execution log
* Added response time reporting and filtering
* Update to use the http config context
* Added changelog and contributor info
* Round time output in stdout to nearest millisecond
* Change stdout duration rounding to use Milliseconds()
* Go back to Round() for timing output
* Changed stdout to display millisecond durations
Co-authored-by: Joona Hoikkala <joohoi@users.noreply.github.com>
This change is an attempt to handle gosimple linter finfings in order to
make the code easier to follow. It includes the following changes:
- use strings.Contains instead of strings.Index != -1
- use time.Since which is the standard library helper. See https://github.com/golang/go/blob/go1.15.2/src/time/time.go#L866-L867
- remove unneeded return statements at the end of methods
- preallocate maps when their capacity is known
- avoid underscoring values when they can be omitted
- avoid fmt.Sprintf() calls when the only argument is already a string
Signed-off-by: Miguel Ángel Jimeno <miguelangel4b@gmail.com>
Use the ReplaceAll helper from the standard library in order to make the
code easier to read. Requires Go 1.12 or higher.
Fixes#301
Signed-off-by: Miguel Ángel Jimeno <miguelangel4b@gmail.com>
* Takes the User-Agent header from a list.
* typo
* base
* Make defining User-agent header case insensitive #171
* -whitespaces
* Make canonical http headers and set default User-Agent only once.
* clean-up
* formatting, canonical customer headers, docs updated
* cleanup
* fmt
* Checking userdefined headers for excluding in canonicalization.
* resolving one conflict
* moved logic back and less resolve conflicts
Co-authored-by: Joona Hoikkala <joohoi@users.noreply.github.com>
* Multiple wordlist support
* Display error correctly if wordlist file could not be opened
* Add back the redirect location
* Support multiple keywords in HTML output and fix wordlist positioning
* Support multiple wordlists for md output
* Support multiple keywords in CSV output
* Improve output for multi keyword runs
* Add changelog entry
* Switch the wordlist filename <-> keyword around to allow tab completion
* Fix the usage example in README
* Added HTML and Markdown output support
* Add HTML color code in HTML template
* Added lines count
* Added content lines to json + csv
* Added changelog entry
* Fixed copy paste mistake
* Changed the html report to be grepable :)
* Grepable output fixed
* Fixed lines count
