SQL Server Management Studio: package

Showing posts with label package. Show all posts

Wednesday, March 28, 2012

Migrating DTS packages

Is there anyway to copy all the DTS packages and jobs in one step from one server to another. I usvally copy one DTS package at a time. As our packages count grown bigger, it became a painful process.
If anyone knows a way to copy these packages and jobs in one then it would be very helpful.

ThanksI don't think you can for DTS: Steps I have used in the past:

Save DTS package to hard drive:
Save DTS package as file on the disk, then copy this file on the target SQL Server and load this DTS package on the target machine. Dont forget to save in SQL Server.

Or...

Run DTS Export Wizard, and transfer this select statement:

SELECT * FROM sysdtspackages WHERE name = 'DTSPackageName'

from the msdb database on the source server to the msdb database on the destination server to transfer the DTSPackageName package.

You may be able to add multi packageName, I have never play around with the code. (Maybe someone else will have an idea)

And...

As for jobs you can create a DTS package and under Task select 15 - Transfer job task and follow the steps. You can do all of your jobs at once.

Hope it works out for you.

Thanks

Lystra|||As for the DTS packages go to http://www.sqldts.com/default.aspx?242 This is a free tool to migrate the DTS packages in one step.

Monday, March 26, 2012

migrating (cloning?) DTS mapping

I have a DTS package on SQL Server 2000 that loads a table from a text file daily. The text file has 148 distinct fields that are mapped to a corresponding 148 columns on the table. I need to recreate the package to SQL Server 2005. Is there any shortcut to replicating the mapping from DTS to SSIS or do I need to redo from the beginning?

Dennis Cronin wrote:
I have a DTS package on SQL Server 2000 that loads a table from a text file daily. The text file has 148 distinct fields that are mapped to a corresponding 148 columns on the table. I need to recreate the package to SQL Server 2005. Is there any shortcut to replicating the mapping from DTS to SSIS or do I need to redo from the beginning?

If there are 148 columns in both source and destination then you can probably use the Import Wizard to build the package for you and then adapt it as you wish. very easy and very quick.

-Jamie

Monday, March 19, 2012

Migrate DTS 2000 package doesn't work

Hi everyone,

I'm stuck with this and I haven't idea how to solve it. I'm trying to migrate a dts 2000 package from BIDS and I obtain this message:

This wizard will close because it encountered the following error:

Index was out of range. Must be non-negative and less than the size of the collection.
Parameter name: index (mscorlib)

I'm going to Migrate DTS 2000 Package select my current sql2k production server (it has almost 600 dts although I think that is not any problem at all)

Wizard recognize without problems my server and then I put a folder for save them but on the next step appears the aforementioned message.

Does anyone ever faced this issue?

Thanks in advance,

I'm having the same problem. I have a 2-node cluster and I was able to successfully migrate packages from one but the other one behaved exactly as you've described. Any luck overcoming this?

Migrate DTS 2000 package doesn't work

Hi everyone,

I'm stuck with this and I haven't idea how to solve it. I'm trying to migrate a dts 2000 package from BIDS and I obtain this message:

This wizard will close because it encountered the following error:

Index was out of range. Must be non-negative and less than the size of the collection.
Parameter name: index (mscorlib)

I'm going to Migrate DTS 2000 Package select my current sql2k production server (it has almost 600 dts although I think that is not any problem at all)

Wizard recognize without problems my server and then I put a folder for save them but on the next step appears the aforementioned message.

Does anyone ever faced this issue?

Thanks in advance,

I'm having the same problem. I have a 2-node cluster and I was able to successfully migrate packages from one but the other one behaved exactly as you've described. Any luck overcoming this?

Migrate DTC

Hi guys,
I have an existing sql 2k enterprise server and we're going to configure it
for server clustering. We have custom made DTC package and most of the
application use it very often.
My concern is how do we migrate this custom made DTC package to the new
environment(sql cluster)?
Appreaciate ur guys help.
Hidayat
Message posted via http://www.droptable.com
I maybe missing something; due my true lack of understanding MSDTC, but I
don't think you have anything to migrate. MSDTC as far as I know, is just a
log file, and a new install will use a new log file. This should be a walk
in the park.
Cheers,
Rod
MVP - Windows Server - Clustering
http://www.nw-america.com - Clustering Website
http://msmvps.com/clustering - Blog
"Hidayat via droptable.com" <forum@.nospam.droptable.com> wrote in message
news:4FE03924D8C20@.droptable.com...
> Hi guys,
> I have an existing sql 2k enterprise server and we're going to configure
> it
> for server clustering. We have custom made DTC package and most of the
> application use it very often.
> My concern is how do we migrate this custom made DTC package to the new
> environment(sql cluster)?
> Appreaciate ur guys help.
> Hidayat
> --
> Message posted via http://www.droptable.com
|||tks for your prompt reply.
Another question i would like to ask is do we need different virtual ip for
MSDTC & SQL cluster? Can we use the existing virtual ip that we configure for
MSCS?
Tks
Message posted via http://www.droptable.com
|||If MSDTC has heavy usage then give it its own Group - with an Virtual IP,
Virtual Name, Physical Disk, and the MSDTC resource. If it is not a heavy
hitter, then don't worry about it.
Cheers,
Rod
MVP - Windows Server - Clustering
http://www.nw-america.com - Clustering Website
http://msmvps.com/clustering - Blog
"Hidayat via droptable.com" <forum@.droptable.com> wrote in message
news:4FE4339FB56C0@.droptable.com...
> tks for your prompt reply.
> Another question i would like to ask is do we need different virtual ip
> for
> MSDTC & SQL cluster? Can we use the existing virtual ip that we configure
> for
> MSCS?
> Tks
> --
> Message posted via http://www.droptable.com
|||Can the physical disk for MSDTC be the same(sharing) for the SQL cluster
physical disk?
In SQL cluster environment, how is the procedure of restoring the database?
Is it the same as normal SQL restore using it's own utility. As i know the
data will centrally reside in the SAN(EMC) storage.
Tks
Message posted via http://www.droptable.com
|||You can share the space. But if it is heavily used that maybe a bad idea.
Everything about a database is the same, restore, attach, etc. The Books
Online are wonderful and full of great information.
Cheers,
Rod
MVP - Windows Server - Clustering
http://www.nw-america.com - Clustering Website
http://www.msmvps.com/clustering - Blog
"Hidayat via droptable.com" <forum@.droptable.com> wrote in message
news:4FE89EBC9A9E0@.droptable.com...
> Can the physical disk for MSDTC be the same(sharing) for the SQL cluster
> physical disk?
> In SQL cluster environment, how is the procedure of restoring the
> database?
> Is it the same as normal SQL restore using it's own utility. As i know the
> data will centrally reside in the SAN(EMC) storage.
> Tks
> --
> Message posted via http://www.droptable.com
|||Clustered SQL servers look and act just like normal SQL servers for amost
every purpose, including backup and restore. There are some extra steps for
things like restoring master, adding disks, and adding/dropping cluster
nodes but these are well documented. From the client's point of view, they
look and act exactly like any other SQL server.
Geoff N. Hiten
Microsoft SQL Server MVP
"Hidayat via droptable.com" <forum@.droptable.com> wrote in message
news:4FE89EBC9A9E0@.droptable.com...
> Can the physical disk for MSDTC be the same(sharing) for the SQL cluster
> physical disk?
> In SQL cluster environment, how is the procedure of restoring the
> database?
> Is it the same as normal SQL restore using it's own utility. As i know the
> data will centrally reside in the SAN(EMC) storage.
> Tks
> --
> Message posted via http://www.droptable.com
|||Tks for the explaination. Just to confirm with u guys. Let's say that i have
2 node(A & B). I install and configure SQL cluster on Node A. Must i install
the SQL cluster on Node B?
Message posted via http://www.droptable.com
|||Tks a million guys. Let's say that i have 5GB each on 2 servers. Should i
enabled /3GB or /PAE or AWE? What is u guys best recommendation. I'm going to
configure clustering this Saturday and will be in production.
This clustering is new to me so tks for your patient in answering my question.
U guys have been very helpful.
Tks.
Message posted via http://www.droptable.com
|||Great question. You need to 1) talk to you hardware vendor and find out if
/PAE or /AWE are even supported. 2) test the /3GB with whatever the vendor
supports, you may not see any difference or worse, things could get slower,
3) I am guessing you will only need /PAE to see the 5 GB of memory, but this
is a guess - testing will tell all.
Lastly, you are on a very aggressive schedule. It sounds like you need more
testing time to me BEFORE you go live. This being your first cluster, can
you restore it or a node in the case of a failure? Do you fully understand
how to handle service packs, etc. I am not trying to beat you up, you have a
learning curve ahead. After you in production is really not the way to
manage and maintain your Highly Available SQL Failover Cluster.
Just my two cents...
Cheers,
Rod
MVP - Windows Server - Clustering
http://www.nw-america.com - Clustering Website
http://msmvps.com/clustering - Blog
"Hidayat via droptable.com" <forum@.droptable.com> wrote in message
news:4FF0A99441520@.droptable.com...
> Tks a million guys. Let's say that i have 5GB each on 2 servers. Should i
> enabled /3GB or /PAE or AWE? What is u guys best recommendation. I'm going
> to
> configure clustering this Saturday and will be in production.
> This clustering is new to me so tks for your patient in answering my
> question.
>
> U guys have been very helpful.
> Tks.
> --
> Message posted via http://www.droptable.com

Monday, March 12, 2012

Migrate

I have developed a web application using MSDE. I do not have sql 2000. I now have to transfer this database to an asp host.
Is there a DTS package or osql commands that I can export the entire database sp and all to a sql script file.

Regards
S(:You can create scripts for all of the database objects (tables, view, sprocs, etc.) but I don't believe you can create scripts for the data too. You can use DTS to copy the data, however, after you create the objects.

I haven't tried this with MSDE but with Sql Server databases you can detach them from your local database and physically copy the database files to the remote destination and then re-attach them there. The database has to be compatible with where you are attaching it and whether it considers MSDE files compatible is the question.

Friday, March 9, 2012

Microsoft.SqlServer.Dts.Runtime ASP.NET Security Issue

I am struggling in calling an SSIS package programatically using the Microsoft.SqlServer.Dts.Runtime namespace.

I am succesfuly connecting to the package insofar as I am able to retrieve the package ID (GUID), but when I call package.Execute I get a 'login failed for user' error, which indicates a security problem.

My ASP.NET app is running as a domain user which has temporary 'SA' rights on the server where the package is hosted. In addition, I have set the protection level on the package to 'DontSaveSensitive'.

What am I missing to be able to execute the package remotely?

TIA,

Rick

This depends on how you deployed your packages -- I've encountere this problem a few times myself.

If you've deployed your package on the server, one of the things that you may want to check are the SQL security settings e.g., Windows authentication will go kaput if you have a firewall between your web and db servers, etc.

If you deployed it through file system you might want to check your package's ProtectionLevel property. The default EncriptSensitiveWithUserKey is the way to go (at least in my case) for this.

Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException

I have a SSIS project that has one parent package and three child packages. When I run the project on my development machine in debug mode it works fine. Also if i run the packages using dtexec on my development machine it still works fine. However the problem comes in when I try and run the project using dtexec on the staging server i get the following error:

Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.

does anyone have any idea how to fix this please?

thanks

Probably the data on staging server is different from the data on development machine?

You are trying to put data into buffer that is bigger than the buffer column size allocated for this data. E.g. script component builds some string, gets a string of length 60, and then tries to put it into STR column of length 50 - you'll get this exception as a result. You need to adjust the column size to match expected data, or cleanup the input data to avoid the overflow.

You probably don't see it on development machine, because your test data is different and this condition never occurs.

http://msdn2.microsoft.com/en-us/microsoft.sqlserver.dts.pipeline.doesnotfitbufferexception.aspx

|||thanks for the response but I am not sure that that is the problem since I am using the exact same data and exact same packages on both machines?|||

After some testing I have found that when I run the child packages in series as apposed to in parallel it all works fine. This should do for the mean time but if you have any idea why this is could u please let me know.

Thanks for the help.

Gary

|||

Hi again

I have a second package that has the same setup but manipulates a different data set and I am getting this same error but this time I can't find a way around it.

The data and the packages are exactly the same on both servers.On the development server the packages run with no problem but on the staging server I get buffer memory issues.

Anyone know why this is maybe?

It seems that the column width is too wide for the buffer so the buffer is overflowing into a second buffer which is being used by the other child package.

Any ideas?

thanks

|||

Pipeline Buffers are not shared between child and parent packages.

Could you describe what the packages are doing? What component reports this error? Do both dev and staging machine have the same architecture (32-bit, or 64-bit)?

|||

In the parent package data is extracted from multiple flat files and bulk inserted into multiple database table. Following this 4 child packages are initiated using the execute package task.

within each child package a data flow is started. In the data flow information is extracted from a table (populated in the parent package). The data is transformed using a script component. A row count is taken and then the data is inserted into a second database table.

After some investigation. I have discovered:

-on the development server the entire package works perfectly with no errors

-on the staging server each child package works when it is the only one executed from the parent package.

-on the staging server when I run two child packages it seems the first child package works fine but in the second package to be executed the script component does not get executed (I inserted a MessageBox and ComponentMetaData.FireInformation and there was no output).

This is the error message in the log when running all 4 child packages together:

OnError,,,Transform Data Into MerchantMasterMonthly,,,2006/06/29 02:12:57 PM,2006/06/29 02:12:57 PM,0,0x,The value is too large to fit in the column data area of the buffer. Record ID - Merchant Number (ODS: QMAKBACCTNBR) : 00000000000000000002063 MerchantNumber (ODS: QMAKBACCTNBR)OnInformation,,,Transform Data Into MerchantStatementsMonthly,,,2006/06/29 02:15:07 PM,2006/06/29 02:15:07 PM,1074016264,0x,Post Execute phase is beginning.

OnInformation,,,ODS To DWH MerchantStatementsMonthly,,,2006/06/29 02:15:07 PM,2006/06/29 02:15:07 PM,1074016264,0x,Post Execute phase is beginning.

OnInformation,,,TrOnError,,,Transform Data Into MerchantMasterMonthly,,,2006/06/29 02:23:03 PM,2006/06/29 02:23:03 PM,-1073450910,0x,Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.
at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)
at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper90 wrapper, Int32 inputID, IDTSBuffer90 pDTSBuffer, IntPtr bufferWirePacket)
OnError,,,ODS To DWH MerchantMasterMonthly,,,2006/06/29 02:23:03 PM,2006/06/29 02:23:03 PM,-1073450910,0x,Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.
at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)
at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper90 wrapper, Int32 inputID, IDTSBuffer90 pDTSBuffer, IntPtr bufferWirePacket)
OnError,,,Transform Data Into MerchantMasterMonthly,,,2006/06/29 02:23:06 PM,2006/06/29 02:23:06 PM,-1073450974,0x,The ProcessInput method on component "Script Component" (10641) failed with error code 0x80131600. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

OnError,,,ODS To DWH MerchantMasterMonthly,,,2006/06/29 02:23:06 PM,2006/06/29 02:23:06 PM,-1073450974,0x,The ProcessInput method on component "Script Component" (10641) failed with error code 0x80131600. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

OnError,,,Transform Data Into MerchantMasterMonthly,,,2006/06/29 02:23:07 PM,2006/06/29 02:23:07 PM,-1071636284,0x,The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

OnError,,,Transform Data Into MerchantMasterMonthly,,,2006/06/29 02:23:07 PM,2006/06/29 02:23:07 PM,-1073450975,0x,Thread "WorkThread0" has exited with error code 0x80131600.

OnError,,,ODS To DWH MerchantMasterMonthly,,,2006/06/29 02:23:07 PM,2006/06/29 02:23:07 PM,-1071636284,0x,The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

OnError,,,ODS To DWH MerchantMasterMonthly,,,2006/06/29 02:23:07 PM,2006/06/29 02:23:07 PM,-1073450975,0x,Thread "WorkThread0" has exited with error code 0x80131600.

OnError,,,Transform Data Into MerchantMasterMonthly,,,2006/06/29 02:23:09 PM,2006/06/29 02:23:09 PM,-1073450952,0x,The PrimeOutput method on component "Q19400D" (1) returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

OnError,,,ODS To DWH MerchantMasterMonthly,,,2006/06/29 02:23:09 PM,2006/06/29 02:23:09 PM,-1073450952,0x,The PrimeOutput method on component "Q19400D" (1) returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

The development server is 32 bit and the staging server is 64bit but they are both runnning 32 bit operating systems.

Any help would be appreciated.

thanks

|||

We had somewhat the some problems as described above. We are implementing a datawarehouse-solution using sql2005 and an 64bit windows 2003 server. We use workflow packages that executes childpackages simultaniously. Errors concerning memory and buffers popped up at random in different childpackages.

We installed SP1 and the Cumulative hotfix package (build 2153). This helped a little but didn't solve all the problems. We are testing for two days now and it seems that changing the SSISpackage-property MaxConcurrentExecutables from -1 to 1 in the workflow package solves the remaining memory and buffer problems. Setting this property prohibits concurrent execution of childpackages.

It seems buffermanagement on 64bit servers is still a bit buggy.

Hope this helps in your case too.

Jan

|||

Thanks for the help. I narrowed the problem down to the script components in the child packages so I deleted them and recreated them and it seems to work fine.

No sure why this is. Any one know?

|||

Strange.

Did you create them in a beta version?

Do you have a copy of the old package? Maybe check the differences in the XML in the .dtsx file.

-Jamie

|||

hi,

I also have same problem and also recreate my Task....but not solve my problem

I'm using Script Component Task to do custom transformation.
I add 12 output columns in output0.
5 of these columns is DT_STR and their length is 4, 3 is DT_STR 2, 3 is
DT_STR 12 and 1 is DT_I4.

When executing the package ,I get an exception as below.

The value is too large to fit in the column data area of the buffer.
at Microsoft.SqlServer.Dts.Pipeline.PipelineBuffer.SetString(Int32
columnIndex, String value)
at Microsoft.SqlServer.Dts.Pipeline.PipelineBuffer.set_Item(Int32
columnIndex, Object value)
at Microsoft.SqlServer.Dts.Pipeline.ScriptBuffer.set_Item(Int32
ColumnIndex, Object value)
at
ScriptComponent_04dc3685b8d744898f09d88716141989.Output0Buffer.set_isjsst(String
Value)
at
ScriptComponent_04dc3685b8d744898f09d88716141989.ScriptMain.Input0_ProcessInputRow(Input0Buffer
Row)
at
ScriptComponent_04dc3685b8d744898f09d88716141989.UserComponent.Input0_ProcessInput(Input0Buffer
Buffer)
at
ScriptComponent_04dc3685b8d744898f09d88716141989.UserComponent.ProcessInput(Int32
InputID, PipelineBuffer Buffer)
at
Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32
inputID, PipelineBuffer buffer)

I debug and find the execption comes form output0Buffer set value.
I alse do some testing,
1.Create a simple package wiht same Script Component Task and find no
exception.
2.Remove some output0 columns and find no exception.
It's very confusing me...

Any help is very appreciated.

|||I had the same error and exception. I deleted and recreated the script component and the destination component that the output from the script component was going to. It works for me now.|||was getting the same error - found the resolution was to make sure the output column created in the design script was set to the same size as the source column .

In my case I was trying to set the desitination column to 35, since that is the size of the ultimate destination column in the destination database. Even though I was making sure the string inside the script was truncating to 35 characters, the design script component would still throw the error.

I instead create a derived column component immediately following the script component, and use that one to do the trucation to the destination column size...|||In my case it was Custom Component which did not update OutputBuffer field lengths after a change in a Source component

Thanks team for pointing the right direction!