User Controls
What are you doing at the moment
-
2023-03-23 at 1:20 AM UTChttps://files.catbox.moe/9zb6zn.py
import requests
from bs4 import BeautifulSoup
# define the URL pattern and the total number of pages DONT FORGET USER NUMBER
url_pattern = "https://niggasin.space/user//posts?p={}"
total_pages = 5
# create a list to store the post text from each page
all_posts = []
# loop through each page and extract the post text
for page_num in range(1, total_pages + 1):
url = url_pattern.format(page_num)
response = requests.get(url)
soup = BeautifulSoup(response.content, 'html.parser')
post_blocks = soup.find_all('div', class_='post-block')
for block in post_blocks:
post_body = block.find('div', class_='post-body')
if post_body:
all_posts.append(post_body.get_text())
# write the post text to a file
with open('all_posts.txt', 'w', encoding='utf-8') as f:
for i, post in enumerate(all_posts):
f.write(f'[post {i+1}]\n{post}\n\n') -
2023-03-23 at 1:25 AM UTCI wrote something similar in perl a while back
if you want to be able to work on individual posts you probably want to store them in a database or something, trying to separate them again is going to be confusing as shit because plenty of posts have the word 'post' or two linebreaks in them -
2023-03-23 at 1:26 AM UTC
-
2023-03-23 at 1:31 AM UTC
Originally posted by aldra I wrote something similar in perl a while back
if you want to be able to work on individual posts you probably want to store them in a database or something, trying to separate them again is going to be confusing as shit because plenty of posts have the word 'post' or two linebreaks in them
i tjhink it's retarding something unless he really did post kyivforum twice
this seems fuckey but not too hard to work with like if I got all the posts they would each be numbered, kinda. Probably hard to work with in CODE but I just wanted the raw text posts for a backup kinda
https://niggasin.space/user/6311/posts -
2023-03-23 at 1:35 AM UTChe did lol
posted it in two different threads -
2023-03-23 at 1:37 AM UTChttps://www.sqlitetutorial.net/sqlite-python/
relatively simple way to get started with sql databases if you're interested
instead of having to create and manage the database using something like mysql or postgres it creates a virtual sql database as a file on your machine -
2023-03-23 at 1:47 AM UTCI was trying to make a GUI but pyqt is a nigger and the AI broke my GUI code . I still have the working version from before it tried hooking the buttons
I think it's some issue with define: class something idk if you can have two defines class with the same name in both files if one is calling the other
Like why the fuck does "total_posts" need to be defined when I hook it up to a GUI when the code works just fine without defining it. Looks defined already to me not like a class but I CAN TELL what it is ,
import tkinter as tk
from tkinter import filedialog
from postgrapber import PostGraber
# create the UI window
window = tk.Tk()
window.title('Post Scraper')
window.geometry('400x300')
# add a label at the top of the window
# image = tk.PhotoImage(file='swamp.png')
# label = tk.Label(window, image=image)
# label.pack()
# instantiate the PostGraber object
tool = PostGraber()
# add a button to trigger the scraping
def scrape():
tool.scrape_posts()
tk.messagebox.showinfo('Scraping complete', 'All posts have been scraped.')
button = tk.Button(window, text='Scrape Posts', command=scrape)
button.pack()
window.mainloop() -
2023-03-23 at 1:51 AM UTCpython triggers me, I think I might just be retarded though.
I am not familiar with "high level" languages I guess, like C# and HTML or CSS or js I have a much easier time with, or even the Ethereum solidity code. -
2023-03-23 at 1:51 AM UTC
-
2023-03-23 at 1:52 AM UTCyeah I dunno about that, always written terminal/web shit, GUIs are gay
-
2023-03-23 at 1:53 AM UTC
-
2023-03-23 at 1:53 AM UTC
Originally posted by Stupid noob opened the secret cow portal python triggers me, I think I might just be retarded though.
I am not familiar with "high level" languages I guess, like C# and HTML or CSS or js I have a much easier time with, or even the Ethereum solidity code.
sounds like you need to read a bit about how object oriented programming in general works
C# and js are pretty similar, HTML and CSS aren't programming languages, they're just markup to define formatting -
2023-03-23 at 1:54 AM UTC
-
2023-03-23 at 1:55 AM UTC
-
2023-03-23 at 1:59 AM UTC
pretty sure that was from early in the DirectX days when they were trying to make complex animations in under 64kb or something just using math and directx calls -
2023-03-23 at 2:04 AM UTCI don't know what a directX call is but I want complex animations under 64kb
-
2023-03-23 at 2:10 AM UTCdirectx is the windows graphics API
like if you were going to make a game in unity or some shit it sits under unity and sends all the graphical instructions to windows to render -
2023-03-23 at 2:22 AM UTCSo you can just call that shit directly with code to draw a triangle? draw it on what though. I don't remember windows having any pre built rendering tools, or maybe it does and i'm retarded.
I tried to learn programming a lot when I was young but never had internet and pretty much every book I got besides BASIC and HTML wanted me to download a compiler or would come with a CD but my computer was too shit to run it or something
I feel like I should have experience using visual basic studio but I remember it always just not working or being very fucked to use but it seems more accessible to me now, idk why. -
2023-03-23 at 2:24 AM UTCJust bypass the password prompts to reconnect
-
2023-03-23 at 2:27 AM UTC
Originally posted by Stupid noob opened the secret cow portal So you can just call that shit directly with code to draw a triangle? draw it on what though. I don't remember windows having any pre built rendering tools, or maybe it does and i'm retarded.
yeah there aren't any userland tools for direct rendering, just the programming interface. typically you'll create a window or assign a screen to directx and tell it to draw triangles; most of the functions we're talking about are just a matter of telling directx to draw a shape, its size and position and to which target
https://learn.microsoft.com/en-us/windows/win32/direct3d9/d3dxcreateboxI tried to learn programming a lot when I was young but never had internet and pretty much every book I got besides BASIC and HTML wanted me to download a compiler or would come with a CD but my computer was too shit to run it or something
I feel like I should have experience using visual basic studio but I remember it always just not working or being very fucked to use but it seems more accessible to me now, idk why.
yeah VS is/was fucked, I haven't used it seriously since... high school? I dunno
unless you're working on a team and/or on a big project I always find full-fledged IDEs to be more trouble than they're worth, would rather stick to a text editor like Geany or Notepad++ (vi/vim if you're a bit of a masochist) unless the project outgrows it