Project: GreySec Data Scraper Program

[EpochRoot]

Hey there, I've actually already made something that scrapes the site, making a new folder for each forum/subforum/thread and a different text document for each post, adding the posts author and date of creation as well as it's content. It's functional but I've got more ideas for what I might want to add to it once I get around to it.

I've also got another little bot for writing posts and I intend to add PM handling to it as well. This was all created using Python and Selenium mainly as a way for me to browse the site from my terminal because I'm just weird like that! :-)

[DeepLogic]

Hey there, I've actually already made something that scrapes the site, making a new folder for each forum/subforum/thread and a different text document for each post, adding the posts author and date of creation as well as it's content. It's functional but I've got more ideas for what I might want to add to it once I get around to it.

I've also got another little bot for writing posts and I intend to add PM handling to it as well. This was all created using Python and Selenium mainly as a way for me to browse the site from my terminal because I'm just weird like that! :-)

 
That's great because I've kind of moved on from this anyway lol. Browsing GS from the terminal would be really cool actually. I use the command line a lot so that would be really nice.

[EpochRoot]

I'd be happy to share the source once I've got it properly set up and once I've squared away some other stuff, with permission from the owner of course!

[Insider]

I'd be happy to share the source once I've got it properly set up and once I've squared away some other stuff, with permission from the owner of course!

I'd be very interested in this. If you don't want to release it for everyone though... you're free to PM me about it instead

[DeepLogic]

I'd be happy to share the source once I've got it properly set up and once I've squared away some other stuff, with permission from the owner of course!

I'd be very interested in this. If you don't want to release it for everyone though... you're free to PM me about it instead :)

 
Yeah, PM me too ;)