question

pavan.kumar100 avatar image
pavan.kumar100 asked

Alteryx only pulls 1 million rows from Snowflake, max

I'm using Alteryx workflows to spool some data from Snowflake. The problem is that for some reason, Alteryx only pulls 1 million records, tops.

The input data tool has no max records marked, it should pull as much as it finds.

This is odd since I thought Alteryx was pretty much meant to be used with very large data sets. Is there some special configuration one needs to apply to pull over million records or is it just something that alteryx cannot do?

I looked in alteryx resources and couldn't find anything mentioning the issues. I don't know where to begin from.

backupdistinctaccount
1 comment
10 |1200
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

anthony.green avatar image anthony.green commented ·

I’d suggest raising a ticket direct with Alteryx see if they know of the issue.

Everything I can see suggests a row size limit but not row count limit so you can have trillions of rows as long as each row is less than 2GB.

0 Likes 0 ·

1 Answer

·
pavan.kumar100 avatar image
pavan.kumar100 answered

If you want to select the data from a specific time having the values as string, since you have the values ordered like that (yyyymmdd) you could change them with a to_number function and select the ones in a specific period.trim this down to a more manageable size, a 52 minute alteryx run


10 |1200
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.