User Controls
THis sit =e is dead
-
2019-03-11 at 5:04 AM UTC
Originally posted by -SpectraL ie:
Yeah, go for it, you fucker. If you want to write a management command(django's mechanism for scripts that don't happen as part of the request/response cycle), but I'll bet you're too dumb for it, to pull it straight from the DB and dump that god damned garbage into some CSV files or something I wouldn't mind running it and just sending your idiotic ass the output instead of you having to scrape everything using that shovel nose of yours. Obviously it would have to only output publicly available data for you to piss all over, but that's probably cleaner than fucking parsing the markup and trying to extract the son-of-a-bitch that way.
Wut?
Nigga I'm drinking scotch, snorting k, and smoking crack right now.
I'm pretty much that right now.
Except my script I wrote while (mostly) sober, so it works. -
2019-03-11 at 5:07 AM UTCI don't know django right now.
I could prolly figure it out if I was a bit more sober and clear headed and had a few hours, maybe even days, to go over the docs.
But right now, my script is doing it's thing, and not too inefficiently from what I can tell.
It's actually just about to reach 30% done. -
2019-03-11 at 5:10 AM UTC
Originally posted by -SpectraL Obviously it would have to only output publicly available data for you to piss all over, but that's probably cleaner than fucking parsing the markup and trying to extract the son-of-a-bitch that way.
I don't even mind parsing markup.
I actually kinda like doing it from time to time.
I've spent quite a bit of time knee deep in the NiS HTML/CSS when making my GreaseMonkey script for blocking infinityshock.
The general structure of NiS templates is pretty familiar to me. -
2019-03-11 at 6 AM UTCPeople spending hours just to get rid of poor ol' finny. Sad.
-
2019-03-11 at 6:01 AM UTCInteresting...
Among the first ten thousand threads, the following threw some kind of error (I didn't try to capture which type of error in particular, I might explore that later):
[1, 15, 18, 23, 37, 156, 161, 171, 193, 225, 244, 252, 318, 319, 453, 467, 479, 523, 546, 569, 584, 585, 622, 636, 639, 644, 647, 681, 708, 751, 765, 772, 776, 782, 789, 796, 811, 820, 839, 844, 937, 966, 971, 973, 990, 994, 997, 1002, 1028, 1034, 1068, 1129, 1163, 1183, 1477, 1513, 1630, 1864, 1865, 1875, 1952, 1962, 2042, 2044, 2080, 2099, 2108, 2193, 2201, 2217, 2226, 2240, 2261, 2352, 2373, 2398, 2424, 2457, 2479, 2510, 2543, 2547, 2566, 2577, 2588, 2608, 2637, 2687, 2699, 2713, 2744, 2772, 2775, 2791, 2807, 2862, 2873, 2905, 2916, 2968, 2991, 3060, 3065, 3066, 3069, 3070, 3071, 3074, 3091, 3098, 3123, 3132, 3157, 3165, 3167, 3175, 3208, 3214, 3216, 3220, 3232, 3241, 3247, 3258, 3291, 3298, 3299, 3300, 3302, 3306, 3319, 3367, 3501, 3719, 3728, 3837, 3979, 3999, 4041, 4042, 4049, 4054, 4058, 4073, 4075, 4077, 4078, 4086, 4150, 4219, 4330, 4381, 4393, 4414, 4415, 4421, 4425, 4499, 4507, 4515, 4602, 4644, 4649, 4653, 4654, 4706, 4719, 4748, 4762, 4779, 4780, 4793, 4797, 4801, 4814, 4817, 4822, 4828, 4831, 4866, 4873, 4878, 4964, 4992, 5011, 5026, 5032, 5060, 5132, 5137, 5190, 5194, 5203, 5235, 5242, 5244, 5246, 5289, 5307, 5339, 5372, 5555, 5594, 5596, 5678, 5699, 5700, 5768, 5942, 5994, 6050, 6087, 6214, 6227, 6239, 6299, 6307, 6313, 6326, 6348, 6353, 6358, 6384, 6402, 6410, 6422, 6433, 6465, 6491, 6495, 6502, 6533, 6581, 6607, 6625, 6638, 6643, 6660, 6722, 6727, 6746, 6850, 6857, 6872, 6887, 6897, 6906, 6913, 6924, 6969, 6974, 6980, 6986, 6996, 7004, 7015, 7017, 7035, 7097, 7100, 7117, 7121, 7130, 7137, 7150, 7160, 7182, 7184, 7186, 7213, 7231, 7262, 7274, 7276, 7323, 7376, 7401, 7402, 7478, 7479, 7481, 7483, 7553, 7561, 7603, 7643, 7644, 7686, 7694, 7698, 7709, 7747, 7751, 7765, 7822, 7863, 7867, 7879, 7924, 7949, 7952, 7963, 7978, 7991, 8002, 8010, 8013, 8034, 8056, 8083, 8104, 8112, 8120, 8141, 8149, 8163, 8185, 8206, 8224, 8231, 8242, 8243, 8293, 8332, 8400, 8418, 8449, 8450, 8462, 8469, 8472, 8477, 8478, 8480, 8484, 8485, 8501, 8511, 8516, 8525, 8608, 8638, 8646, 8656, 8666, 8668, 8679, 8687, 8697, 8698, 8722, 8732, 8734, 8761, 8766, 8789, 8807, 8858, 8874, 9110, 9116, 9119, 9126, 9131, 9155, 9204, 9242, 9256, 9284, 9330, 9339, 9347, 9350, 9410, 9412, 9449, 9478, 9483, 9499, 9537, 9591, 9593, 9597, 9618, 9662, 9693, 9712, 9724, 9737, 9748, 9759, 9763, 9767, 9776, 9873, 9908, 9928, 9997] -
2019-03-11 at 6:02 AM UTC
-
2019-03-11 at 1:03 PM UTC
-
2019-03-11 at 5:15 PM UTC
Originally posted by gadzooks Interesting…
Among the first ten thousand threads, the following threw some kind of error (I didn't try to capture which type of error in particular, I might explore that later):
[1, 15, 18, 23, 37, 156, 161, 171, 193, 225, 244, 252, 318, 319, 453, 467, 479, 523, 546, 569, 584, 585, 622, 636, 639, 644, 647, 681, 708, 751, 765, 772, 776, 782, 789, 796, 811, 820, 839, 844, 937, 966, 971, 973, 990, 994, 997, 1002, 1028, 1034, 1068, 1129, 1163, 1183, 1477, 1513, 1630, 1864, 1865, 1875, 1952, 1962, 2042, 2044, 2080, 2099, 2108, 2193, 2201, 2217, 2226, 2240, 2261, 2352, 2373, 2398, 2424, 2457, 2479, 2510, 2543, 2547, 2566, 2577, 2588, 2608, 2637, 2687, 2699, 2713, 2744, 2772, 2775, 2791, 2807, 2862, 2873, 2905, 2916, 2968, 2991, 3060, 3065, 3066, 3069, 3070, 3071, 3074, 3091, 3098, 3123, 3132, 3157, 3165, 3167, 3175, 3208, 3214, 3216, 3220, 3232, 3241, 3247, 3258, 3291, 3298, 3299, 3300, 3302, 3306, 3319, 3367, 3501, 3719, 3728, 3837, 3979, 3999, 4041, 4042, 4049, 4054, 4058, 4073, 4075, 4077, 4078, 4086, 4150, 4219, 4330, 4381, 4393, 4414, 4415, 4421, 4425, 4499, 4507, 4515, 4602, 4644, 4649, 4653, 4654, 4706, 4719, 4748, 4762, 4779, 4780, 4793, 4797, 4801, 4814, 4817, 4822, 4828, 4831, 4866, 4873, 4878, 4964, 4992, 5011, 5026, 5032, 5060, 5132, 5137, 5190, 5194, 5203, 5235, 5242, 5244, 5246, 5289, 5307, 5339, 5372, 5555, 5594, 5596, 5678, 5699, 5700, 5768, 5942, 5994, 6050, 6087, 6214, 6227, 6239, 6299, 6307, 6313, 6326, 6348, 6353, 6358, 6384, 6402, 6410, 6422, 6433, 6465, 6491, 6495, 6502, 6533, 6581, 6607, 6625, 6638, 6643, 6660, 6722, 6727, 6746, 6850, 6857, 6872, 6887, 6897, 6906, 6913, 6924, 6969, 6974, 6980, 6986, 6996, 7004, 7015, 7017, 7035, 7097, 7100, 7117, 7121, 7130, 7137, 7150, 7160, 7182, 7184, 7186, 7213, 7231, 7262, 7274, 7276, 7323, 7376, 7401, 7402, 7478, 7479, 7481, 7483, 7553, 7561, 7603, 7643, 7644, 7686, 7694, 7698, 7709, 7747, 7751, 7765, 7822, 7863, 7867, 7879, 7924, 7949, 7952, 7963, 7978, 7991, 8002, 8010, 8013, 8034, 8056, 8083, 8104, 8112, 8120, 8141, 8149, 8163, 8185, 8206, 8224, 8231, 8242, 8243, 8293, 8332, 8400, 8418, 8449, 8450, 8462, 8469, 8472, 8477, 8478, 8480, 8484, 8485, 8501, 8511, 8516, 8525, 8608, 8638, 8646, 8656, 8666, 8668, 8679, 8687, 8697, 8698, 8722, 8732, 8734, 8761, 8766, 8789, 8807, 8858, 8874, 9110, 9116, 9119, 9126, 9131, 9155, 9204, 9242, 9256, 9284, 9330, 9339, 9347, 9350, 9410, 9412, 9449, 9478, 9483, 9499, 9537, 9591, 9593, 9597, 9618, 9662, 9693, 9712, 9724, 9737, 9748, 9759, 9763, 9767, 9776, 9873, 9908, 9928, 9997]
thread 1 is just over there.
https://niggasin.space/thread/1 -
2019-03-11 at 5:33 PM UTCgadzooks, what is the point of all your effort, may I ask? Why go through the trouble of creating a static version of an active site?
-
2019-03-11 at 5:45 PM UTC
Originally posted by Ajax gadzooks, what is the point of all your effort, may I ask? Why go through the trouble of creating a static version of an active site?
There are actually dozens of potential applications.
One of which is as simple as making a word cloud (an image that shows their most frequently used words from all their posts) for mmQ and Panthrax, since I promised I'd make them one after I made one for infinityshock...
https://niggasin.space/thread/31288?p=1#post-600292
I also want to do some other analytics and stuff, and this way, I won't have to make millions of server requests.
Once I have the data stored locally, and I can play with it as I please. -
2019-03-11 at 7:44 PM UTC
Originally posted by gadzooks There are actually dozens of potential applications.
One of which is as simple as making a word cloud (an image that shows their most frequently used words from all their posts) for mmQ and Panthrax, since I promised I'd make them one after I made one for infinityshock…
https://niggasin.space/thread/31288?p=1#post-600292
I also want to do some other analytics and stuff, and this way, I won't have to make millions of server requests.
Once I have the data stored locally, and I can play with it as I please.
10-4. Just confirming my suspicion that there is no point. -
2019-03-11 at 9:12 PM UTC
Originally posted by gadzooks Interesting…
Among the first ten thousand threads, the following threw some kind of error (I didn't try to capture which type of error in particular, I might explore that later):
[1, 15, 18, 23, 37, 156, 161, 171, 193, 225, 244, 252, 318, 319, 453, 467, 479, 523, 546, 569, 584, 585, 622, 636, 639, 644, 647, 681, 708, 751, 765, 772, 776, 782, 789, 796, 811, 820, 839, 844, 937, 966, 971, 973, 990, 994, 997, 1002, 1028, 1034, 1068, 1129, 1163, 1183, 1477, 1513, 1630, 1864, 1865, 1875, 1952, 1962, 2042, 2044, 2080, 2099, 2108, 2193, 2201, 2217, 2226, 2240, 2261, 2352, 2373, 2398, 2424, 2457, 2479, 2510, 2543, 2547, 2566, 2577, 2588, 2608, 2637, 2687, 2699, 2713, 2744, 2772, 2775, 2791, 2807, 2862, 2873, 2905, 2916, 2968, 2991, 3060, 3065, 3066, 3069, 3070, 3071, 3074, 3091, 3098, 3123, 3132, 3157, 3165, 3167, 3175, 3208, 3214, 3216, 3220, 3232, 3241, 3247, 3258, 3291, 3298, 3299, 3300, 3302, 3306, 3319, 3367, 3501, 3719, 3728, 3837, 3979, 3999, 4041, 4042, 4049, 4054, 4058, 4073, 4075, 4077, 4078, 4086, 4150, 4219, 4330, 4381, 4393, 4414, 4415, 4421, 4425, 4499, 4507, 4515, 4602, 4644, 4649, 4653, 4654, 4706, 4719, 4748, 4762, 4779, 4780, 4793, 4797, 4801, 4814, 4817, 4822, 4828, 4831, 4866, 4873, 4878, 4964, 4992, 5011, 5026, 5032, 5060, 5132, 5137, 5190, 5194, 5203, 5235, 5242, 5244, 5246, 5289, 5307, 5339, 5372, 5555, 5594, 5596, 5678, 5699, 5700, 5768, 5942, 5994, 6050, 6087, 6214, 6227, 6239, 6299, 6307, 6313, 6326, 6348, 6353, 6358, 6384, 6402, 6410, 6422, 6433, 6465, 6491, 6495, 6502, 6533, 6581, 6607, 6625, 6638, 6643, 6660, 6722, 6727, 6746, 6850, 6857, 6872, 6887, 6897, 6906, 6913, 6924, 6969, 6974, 6980, 6986, 6996, 7004, 7015, 7017, 7035, 7097, 7100, 7117, 7121, 7130, 7137, 7150, 7160, 7182, 7184, 7186, 7213, 7231, 7262, 7274, 7276, 7323, 7376, 7401, 7402, 7478, 7479, 7481, 7483, 7553, 7561, 7603, 7643, 7644, 7686, 7694, 7698, 7709, 7747, 7751, 7765, 7822, 7863, 7867, 7879, 7924, 7949, 7952, 7963, 7978, 7991, 8002, 8010, 8013, 8034, 8056, 8083, 8104, 8112, 8120, 8141, 8149, 8163, 8185, 8206, 8224, 8231, 8242, 8243, 8293, 8332, 8400, 8418, 8449, 8450, 8462, 8469, 8472, 8477, 8478, 8480, 8484, 8485, 8501, 8511, 8516, 8525, 8608, 8638, 8646, 8656, 8666, 8668, 8679, 8687, 8697, 8698, 8722, 8732, 8734, 8761, 8766, 8789, 8807, 8858, 8874, 9110, 9116, 9119, 9126, 9131, 9155, 9204, 9242, 9256, 9284, 9330, 9339, 9347, 9350, 9410, 9412, 9449, 9478, 9483, 9499, 9537, 9591, 9593, 9597, 9618, 9662, 9693, 9712, 9724, 9737, 9748, 9759, 9763, 9767, 9776, 9873, 9908, 9928, 9997]
Ok I added more explicit exception handling...
It was a mere charmap / character encoding issue.
By reading the failed threads as bytes and in turn saving directly as bytes, problem solved. -
2019-03-12 at 3:24 AM UTC(python 3 confirmed garbage)
-
2019-03-12 at 3:31 AM UTC
-
2019-03-12 at 3:32 AM UTCBy the way, my archiving is all done.
I have every single thread archived, and every members' profile page.
I can pretty much extrapolate anything else I need from that data once I've parsed it locally.
It was a lot quicker than I expected. -
2019-03-12 at 3:33 AM UTCYeah, py3 is fine, but this is a perfect example of how the changes in 3 make some things needlessly annoying.
-
2019-03-12 at 7:14 AM UTCfuckin geeks
-
2019-03-12 at 7:52 AM UTCdumb cunt
-
2019-03-12 at 7:53 AM UTCoff my forums fagget
-
2019-03-12 at 7:56 AM UTCplease die