Complete List of Libraries, Packages and Resources for Quants https://miltonfmr.com/complete-list-of-libraries-packages-and-resources-for-quants/ Found this, thought some find it helpful.
This is a good example why modern IT systems are always full of issues. Way too much tech, so much bloat. Minor version issues and bugs will wreak havoc.
A Quant and a Data Engineer as described here are not necessarily the same person or skill set. A Quant IMHO has much more of a mathematical skill set than the CS/IT technologies shown here. There will of course be overlap in skill sets to some degree.
that pic is bloat. What is really depicted is 1) data access 2) persistence 3) messaging 4) scheduling the rest is basic IT/programming infrastructure things
Some of those Python tools/libs are ok but it's mostly a rabbit hole that won't lead to profitability. And that data engineer pic is part of the reason I hate tech so much lol, so much useless crap to keep up with and it's exhausting. All you really need: quality data: Norgate Data a way to build and test strategies accurately: RealTest or AmiBroker a way to place orders: Interactive Brokers API (Python, C#, whatever) Most of the time should be spent rapidly designing and testing strategies in the pursuit of edge, not fighting crappy tools and infrastructure.
Also, if you are skilled in Hadoop, Spark, Hive, HDFS then you are soo 2019. The new stack is Kafka, Kinesis, Fivetran, Stitch, Singer, Airflow, Dagster, DBT, Dataform, Snowflake and Redshift, if you don't have at least 5 years of experience in all of them you might as well quit your white collar job and get hired as a cashier at Target or so.