VizCanvaz

I recently cleared the DP-700, Microsoft's Fabric Data Engineer Associate certification, and wanted to share what actually worked, in case it helps someone else preparing for it. A few basics before you book it. The exam has 40 to 60 questions, including a case study section of around 10 questions, and you get 100 minutes to complete it, plus an extra 20 minutes upfront for setup and the non-disclosure agreement, so plan for about 120 minutes total at the test center or on your webcam. It's proctored and not open-book, so no notes, no second monitor, and no wandering off camera. You'll need a government-issued photo ID that matches your Microsoft Learn profile exactly. One thing a lot of people don't realize going in, Microsoft's exam interface includes a Reference option that lets you pull up relevant Microsoft Learn documentation during the exam. It's genuinely useful, but treat it as a last resort, not a first move. Searching documentation mid-question eats i...

Snowflake has become the backbone of a lot of the data platforms I've worked on, and along the way I've picked up a few habits that make a real difference between a warehouse that scales gracefully and one that quietly burns through credits. Here they are. Warehouses are not one-size-fits-all. It's tempting to run everything, ETL loads, BI dashboards, ad hoc analyst queries, through a single virtual warehouse. Don't. Separate warehouses by workload so a heavy transformation job doesn't queue behind someone's Tableau refresh, and so you can size and auto-suspend each one independently. A small warehouse for BI traffic and a larger one for batch loads will almost always cost less than one oversized warehouse trying to do both. Auto-suspend aggressively, auto-resume freely. Snowflake bills by the second, so there's rarely a good reason to leave a warehouse running idle. Set auto-suspend to a minute or two for most workloads. The resume time is fast enough that ...

After working with Matillion across different enterprise projects, here are a few practical lessons that have saved me a lot of debugging time. Sharing them in case they help you too. - Design for reusability from day one. It's tempting to build a job that solves today's problem and move on, but don't. Break your transformation logic into Shared Jobs early, even if you're only using it once right now. Matillion's Shared Job feature lets you parameterize common patterns so the next pipeline takes hours instead of days. - Keep orchestration and transformation jobs separate. Orchestration jobs should control flow, sequencing, and error handling. Transformation jobs should do the actual data manipulation. Mixing the two makes jobs hard to read and hard to hand off to a teammate. - Use grid variables instead of hardcoding loops. Instead of duplicating a job for every table or source system, drive it from a grid variable populated by a metadata query. This turns 50 nearly...

The nice way to create KPI's in Tableau with a good or bad indicator is to use the custom format option. Follow the below steps to create a cool looking KPI. At first, create a calculated field in Tableau based on your KPI definition. In my case, I am using the Profit Ratio calculated field in the Super Store sample dataset. Custom format used : ▲ +0"%"; ▼ -0"%"; ► 0"%" Happy Tableauing :)

The easiest way to fetch data from databases to Excel is using the Get Data option available under the Data Tab, Excel creates a query using the ODBC connection and fetches the data without the hassle of coding. But coding makes the process more flexible and is very dynamic. Here goes the details... 1) Download and install the snowflake ODBC driver either 32 or 64 bit depending on your MS Office Installation & OS from the SnowFlake portal, available under the Help menu. 2) Create a DSN with the correct connection properties. 3) Add the below reference if required in the visual basic editor and also change the DSN name in the VBA code. VBA Code...  '----------------------------------------------------------------------------------------------------------------------------------------- Sub VBA_SnowFlake_Connect() Dim sSQLQry As String Dim ReturnArray Dim Conn As ADODB.Connection Dim rs As ADODB.Recordset Dim DBPath As String, sconne...

Do you guys know about IFTTT? IF This Then That is really a cool service that makes your life easy. I was thinking of saving my Uber rides trip details to google sheets to track my monthly Uber usage and I found this cool service. It is a free way to get your apps talk to each other. You can automate most of your daily tasks using IFTTT .   There is n number of services available and it is free, you just have to download the app or go to the webpage to make it work. To create your fist IFTTT applet just click on My Applets and then on New Applet After that Click on +this and choose a service from the list and once it's done create that service.