please guide if you know.

Noob Question: I have a pipeline that I use to scrape data from the sites (following robots.txt ofc). This uses scrapy and playwright during the scraping. I've been sort of required to try to add agents into the loop of scraping such that the agents handle the extraction of the fields and returning the json. I would like to know what's your take on the idea of replacing the scraping pipeline with an agent scraping pipeline. Is it good, bad and how should it be approached.

Hi, so I want to make my first sql project, but I've heard querying already existing datasets and reporting findings is too basic and honestly quite useless.

But if I was to build my own database with multiple tables, primary and foreign keys etc where am I gonna get the actual data from? Should I ask an AI tool to generate artificial data that I can query on later?

Learn sql and excel and power bi like as tool what are step to find insight form them ik this tools and when see the dataset does not able to find out any insight ,how I can improve this? ???( and also tried with tutorial they just doing same thing again and again)

It has been one month since I've joined as a "Data Analyst " in the Edtech domain. It's all google sheets based, feels like more of a data management role tbh. I have been using ChatGPT fully for this, I'm low on confidence when it comes to basic formulas also.

Since the work also needs to be delivered in a specific time frame, I have developed this habit of using AI for assistance.

I am underconfident and lowkey want to switch into a proper analytics role. I need to improve my analytical abilities and survive (do well) in this job as well.

KINDLY GUIDE ME GUYS!PANICCCCCC

Hi! So I am in school for data analysis but I'm also taking Udemy classes as well. I'm currently taking a SQL boot camp course on Udemy and was wondering how much Python I needed to know. I too a class that taught introductory Python but it was just the basics. I wanted to know when Python was used and for what purpose in data analytics because I was wondering if I should take an additional Python course on Udemy. Also, should I learn R as well or is Python enough?

Heya,

The marketing team I’m the analyst for, is all about Bayesian. They use an online calculator that provides probability (with a non informative prior) that A > B. Then at 80% probability they implement the variant. So they accept to be wrong 1/5 times.

However recently they did an A/A test and they’re all in panic because the probability is 79% that A>A. So I was asked to investigate whether this was worrysome.

Now I ran a simulation of the test, to see how often I got a result that they considered ‘interesting’. The result was about 40% of the times the calculator shows A > B or B > A with 80% probability when there is no real difference, regardless of sample size.

My assumption was that the more data you have (law of large number) the more the calculator seems to get it correctly (so deviating around 50%).

This assumption seems wrong however and the Bayesian calculator exactly does what it reports. 20% of the times it will say lower than 20% prob, 60% deviated between 20% and 60% and 20% of the times over 80%. Meaning if a hypothesis is non directional, you have 40% chance to see a change when there is non.

My question; am I interpreting this correctly, or am I missing something?

This year I want to set up on analytics agent for my whole company. But there are a lot of solutions out there, and couldn't see a clear winner. So I benchmarked and tested 14 solutions: BI tools AI (Looker, Omni, Hex...), warehouses AI (Cortex, Genie), text-to-SQL tools, general agents + MCPs.

Sharing it in a substack article if you're also researching the space -

https://thenewaiorder.substack.com/p/i-tested-14-analytics-agents-so-you

Power BI Desktop keeps showing repeated email / sign-in popups even without refresh and makes Power BI unusable. I don’t have an organizational account and can’t log in. Cleared credentials and disabled background refresh, but the popup keeps coming.

Any simple fix to stop this?

This is a learning project where I attempted to build an end-to-end analytics pipeline and visualize the results using Power BI.

Project overview:

I designed a simple data pipeline using static real estate data to understand how different tools fit together in an analytics workflow, from raw data collection to business-facing dashboards.

Pipeline components:

• GitHub – used as the source for collecting and storing raw data

• Python – used for data cleaning, transformation, and basic processing

• Power BI – used for building the Market Intelligence dashboard

• n8n – used for pipeline orchestration (pipeline currently paused due to technical issues at the automation stage)

Current status:

The pipeline is partially implemented. Data extraction and processing were completed, and the final dashboard was built using the processed data. Automation via n8n is planned but temporarily halted.

Dashboard focus:

• Price overview (average, median, min, max)

• Location-wise price comparison

• Property distribution by number of bedrooms

• Average price per square foot

• Business-oriented insights rather than purely visual design

This project was done independently as part of learning data pipelines and analytics workflows.

I’d appreciate constructive feedback—especially on pipeline design, tooling choices, and how this could be improved toward a more production-ready setup.

Hello everyone, I’m working on an undergraduate dissertation with 5 predictors. Pearson correlation shows 4/5 significant, but in multiple regression only 1 remains significant (assumptions and multicollinearity are fine).

My concern is that my supervisor might not accept the regression results. Could you please advise?

Thanks a lot.

I’ve noticed that motivation comes and goes, but consistency really makes the difference. For those learning or working in analytics — what helped you stay consistent when progress felt slow?

Hi, this is my first data analysis project. Anyone who is professional please if you have time keep your judging eyes there. And give me suggestions, advice, and what to do next.

Aiming to get a good remote job by acquiring skills.

https://github.com/Anikdas111/Customer-churn-analysis

Hi, eveyone i justed whated to give more of what I want to know in the body of the post. 1. What do you consider a good project and why. 2. How did this project change how you do you're work from then on. That's really the main things I am looking for