I already have a rule file (ex. Rule MM01), and I need to add more data rows in rule MM01 to one dimension like below.
For example I want to add more 100 rows of data in column "Replace" and column "With"
Do I have to add 100 rows one by one? Input manually? Or anything else to add bulk data into a rule file?
Nope, you just have to type them in.
If new items keep on popping-up in your source data, you might consider one of the following:
put your source text file into a SQL table and make your load rule read from the table (or even better, try to directly load from the tables that generated the text file)
(assuming you have the data load automated via MaxL) add a powershell script that does the rename before you load the data
Related
I am trying to load data from text file to a table. The mapping executes successfully but no data is loaded to the staging table. I am using LKM FILE TO SQL and SQL Control Append as IKM. Staging table is created but not loading the rows to the table, insert rows is 0
As I observed you doesn't created the datastore properly, for a text file you have to manually give the proper conditions like fixed or delimited file and then what about delimited separator(,|,..etc) and then view the data . After giving all these you can view your data i.e columns and check whether the datatype is correct or not then creat source file in the model
Example File: https://docs.google.com/spreadsheets/d/1Ht_2QMGMbHmlxSPoOiLX2vw78IL1wp3VhpOOc66eMqY/edit#gid=0
We are filling Point 1 - 4 manually. The data in A,B,C is sorted through C and will change every now and then. The problem I am noticing now is that A,B,C is moving. But D:G will stay in the same column.
We want to use this file to fill in the data since its our main file. So using the initial =query to also take into account D:G is not an option.
Would there be any other way to "link" D:G to the corresponding values in A:C?
Looking at your sheet I noticed you try a VLOOKUP formula.
Please try the following formula
=INDEX(IFERROR(VLOOKUP(A1:A;Blad1!A2:I;{6\7\8\9};0)))
Of course your approach would cause problems. You're trying to map manual data to some data that is bound to change. You can't expect the manual data to move or change in sync when the imported data changes.
You could probably make it work at least if the imported data does not change in order, and instead gets any new data appended. Even then, it doesn't help you if any of the imported rows gets deleted.
There are only two ways I could see to make this work:
Map your manual data as part of the original sheet where your other data is imported from. In other words, make D:G part of the source of A:C, if possible. This is the best approach. Works even when some imported rows get deleted or changed.
Don't sort A:C at source. Simply append new rows, and import as is. Keep your Blad1 sheet as the local source sheet, and add your manual data to D:G here. Then create a new sheet for sorting or do any other thing you'd like, and use this new sheet to feed your Blad2 sheet. This doesn't work if some of the imported rows get deleted or changed.
Need to write a macro for importing a table from all URLs present in column A of Symbols sheet, each URL table should be written to a new sheet with the sheet being named as per the names in column B of Symbols sheet.
Using the below formula to extract table information from URL, which is working.
=IMPORTHTML(symbols!A1, "table",1)
=IMPORTHTML(symbols!A1, "table",3)
A sample sheet URL is below.
https://docs.google.com/spreadsheets/d/1uJPjfAZLRCwafetbH4-nPJPSpTvvgixlFvGG6gYITBU/edit?usp=sharing
Need to customize a few rows and columns which are not required. I believe this can be done by recording a macro and copy-pasting those modification lines to macro.
Edit: I am able to achieve this in MS Excel, one click does the job of importing table, creating a new sheet, copying the table, little formatting. Want to achieve the same in googlesheets.
check the INDEX and ARRAY_CONSTRAIN functions (probably also QUERY and FILTER function too) which are able to trim off the input exactly as you need to.
I have a google spreadsheet which have some columns of data written through a python script. At the end of the last data column I have added three more columns manually and data for those three columns would be entered manually. Python script would run daily, thus updating the data in the spreadsheet. My issue is whenever I run the script to update the data, the data in the last three manual columns gets jumbled. This is because the order of the data returned by the sql query from the script is different everytime. We can use order by to keep the order same but if new rows are added or the existing rows are deleted from the db then this would also not work.
As stated in this related thread, I think it's an expected behavior because the imported data is dynamic and the data you are adding are static.
The idea is that you don't add any columns to the Sheet that receives the imported data as this data is dynamic.
You need to create a new Sheet and select the data from the Sheet that has the imported data.
The Notes Sheet will need you to select the imported data by the order number in this case. The other columns of data will then be extracted from the ImportedData Sheet using the =vlookup() function and displayed and then you would enter the required note for that record.
You may check the link above for more information.
Is there a way in excel to mark the rows with an identifier if any cell in that row is changed without using vb scripts and using a formula ?
Such that while parsing the excel, i can get only those rows which are changed and then i can easily compare those changed rows with the values in the database.
The reason i need to do that is because:
It is a bulk import and each sheet can have 50,000 to million rows.
Data in each row needs to compare with 3-4 database tables
I cannot add vb scripts to those excel sheets because the excel sheets are exported through the same application.
Or is there any other way to efficiently do the bulk import? I'm using the Roo gem and already using the each_row_streaming method.
Afaik there exists no such functionality. Even in the case you would use VBA to mark changed rows, you would run into a validation issues. Let me explain a bit:
Let A be the one changing the data, if she is not such a nice lady she will make her necessary changes but fiddle around with the change indications to break you logic. Why? Because she can. Or because it gives her a business advantage, or ... Even if she is nice, how do you now - for certain - that no change went unnoticed?
I would say your safe option is to always do a full compare on each workbook/row against the database to be sure no change goes unnoticed.
It might be sensible to calculate a hash for each row and store it somewhere in the database. That way you would only need to recompute and compare the hashes. But this depends a lot on your data.