inmysocks (version: awoo) @inmysocks@awoo.space

I am bad at object oriented programming

Like really bad at it

I don't know why

Client < we want to make an rss scraper so we don't have to pay for access to a news ticker api for our historical data so we can get better results by only looking at high quality sources for our market sentiment data!
Me > That isn't how this works, the noise means we only see trends when you have huge amounts of data.
< So can you make the rss scraper? we only need like 10 sources! I want the better results!
> .........
> That isn't how math works.
< But high quality sources! Better results!!

I still maintain that it is objectively bad design to have a programming language where the default behaviour is to run commands synchronously and then when you have an asynchronous function instead of marking that it does something differently, you make the version that behaves the way everything else is the language does.

*glares at javascript and node*

It turns out that my simulations were running about 5x longer than necessary.

It wasn't wrong, but the system reached steady state after about 50k steps and I was running each one for 250k steps.

So instead of only doing one more batch I get to do more batches and hope this gives good data.

@zatnosk no, it is a pretty straight forward select:

SELECT offset, node, run, time, hears, transmitting, received FROM data WHERE run=400

and run is now an index.

It is workable, about 5 seconds per query and it returns ~200k rows.
I was just expecting it to be faster. I don't know if that was an unreasonable expectation at the start.

@ekaitz_zarraga processing the data is still taking less than 1/4 of the time that retrieving it takes, but it is down to about 45 seconds from 5 minutes, so I managed some improvement.

it turns out that my table of ~50 million rows had no index. So that may be part of it.

it is really really annoying but otherwise you get 1000 emails spread out over a week each asking for something tiny that should have been included in the original contract.

Before having to work directly with clients I always thought it was weird that people charged for things like quotes and consultations to determine what a job would be.

Now I fully understand. People have absolutely no respect for your time or expertise and the only way to get them to be at all specific or have their shit together is to change them for every tiny thing.

You want a tiny update? You pay for my time telling me you want the update, and my time making the update

I don't think I will ever understand why some SQL things take as long as they do

@envgen :patcat:

Client < we want to make an rss scraper so we don't have to pay for access to a news ticker api for our historical data so we can get better results by only looking at high quality sources for our market sentiment data!
Me > That isn't how this works, the noise means we only see trends when you have huge amounts of data.
< So can you make the rss scraper? we only need like 10 sources! I want the better results!
> .........
> That isn't how math works.
< But high quality sources! Better results!!

you could use all of that for things like building distributed control systems for mesh networks and security stuff, or adaptive algorithms and machine learning, but that is probably a bit less accessible.

I am also a bit biased because I want to try and write similar things about the more accessible parts of my phd research that have direct applications in lots of stuff people don't realise. Like practical linear algebra which covers any graphics systems, movement in games, 3d representations of objects for games or art, also just about any communication system.
Also information theory and probability for when you want to count cards and figure out the least terrible way to bet on something.

Julia can do 10000 recursive function calls just fine, but it looks like 100000 is too many.

So I guess I can't do this simulation using a pure functional style and tons of recursion.
I am a bit disappointed.

Windows file systems break my git repos.

Forget viruses and climate change, windows file system pathing problems are going to cause the end of humanity.