GreySec Scraper Tool Release
#1
Hello internet users. This is a public service announcement. The greysec scraper previously mentioned in this subforum is functional and it has gathered some data on around 2,000 of the 8,000ish greysec users. You can get the tool and see some of the data collected in its' github repo: https://github.com/ghostwalkr/GreySec-Statistics. Keep in mind though, this thing is in its' infancy. It will have bugs and I could use some help with it. I'll put a todo at the bottom of this thread. Send those pull requests. It's pretty simple to use. Just run it on any system with python3 installed like so (edit: also need to put your cookie into the code):
Code:
python3 scraper.py

 

It'll collect the username, UID, post count, and thread count of every user on GreySec. As I write this the scraper is collecting the data for all 8,000ish users. It'll probaby take between 1-3 hours to run. Feel free to play around with the code or data, it's open source software after all.

 
## EDIT ######
Tool updated on June 6, 2020
If you have any questions let me know below.
 

Todo

- Make it threaded so it runs faster.

- Better logging
Reply


Messages In This Thread
GreySec Scraper Tool Release - by DeepLogic - 05-31-2020, 12:03 AM
RE: GreySec Scraper Tool Release - by EpochRoot - 06-01-2020, 03:53 PM
RE: GreySec Scraper Tool Release - by DeepLogic - 06-01-2020, 05:24 PM
RE: GreySec Scraper Tool Release - by enmafia2 - 06-01-2020, 09:44 PM
RE: GreySec Scraper Tool Release - by Insider - 06-09-2020, 12:20 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  How did you find GreySec? Insider 24 49,568 11-23-2021, 07:03 PM
Last Post: Agonal
  GreySec Social thread. Vector 207 464,761 09-01-2021, 07:58 AM
Last Post: Vector
  GreySec Communication Channels (IRC.. etc) Insider 18 62,015 03-27-2021, 08:12 AM
Last Post: KattStof
  GreySec Forum Statistics (Full Stats) DeepLogic 7 16,298 06-02-2020, 11:15 AM
Last Post: Insider