Python: how to make Anaconda Navigator more responsive

My Anaconda Navigator was VERY slow and I found this SO-Question very useful!!!


https://stackoverflow.com/questions/40933243/anaconda-navigator-very-slow

How to set CurrentCulture for all threads in a domain in .NET 4.5

In your Main-Method add the following lines:


System.Globalization.CultureInfo.DefaultThreadCurrentCulture = new System.Globalization.CultureInfo("en-US");
System.Globalization.CultureInfo.DefaultThreadCurrentUICulture = new System.Globalization.CultureInfo("en-US");

References:
morteza/how-to-set-currentculture-for-all-threads-in-a-domain-in-net-4-5
https://docs.microsoft.com/en-us/dotnet/api/system.globalization.cultureinfo?view=netcore-3.1

Tips and Tricks with the Windows TaskManager

Because every once in a while, you need to use it!


https://old.reddit.com/r/techsupport/comments/gqb915/i_wrote_task_manager_and_i_just_remembered/

Need <, >, & in an XML-Message? Use the XML escape characters!

For Errors like this in SoapUI?


Name cannot begin with the ' ' character, hexadecimal value 0x20.

Then please try escaping the critical characters!

Have a look here:

https://stackoverflow.com/questions/1091945/what-characters-do-i-need-to-escape-in-xml-documents


"   &quot;
'   &apos;
<   &lt;
>   &gt;
&   &amp;


https://validator.w3.org/#validate_by_input

ORACLE: Remove Whitespaces from a string

To remove whitespaces from a string use a regex:

REGEXP_REPLACE(text,'(^[[:space:]]*|[[:space:]]*$)')

Source:
https://stackoverflow.com/

[C] printf() for adults

Fascinating ;)

https://www.maizure.org/projects/printf/index.html

Replace/Remove Timestamps in Files with Notepad++

Text:


31.07.2019 21:47:47 Roses are Red
31.07.2019 21:47:50 Trees are Green
31.07.2019 21:47:50 Sky is Blue
31.07.2019 21:47:50 ...and a Black Hole is lurking in the centre of every fucking Galaxy!


Find what: \d{2}.\d{2}.\d{4} \d{2}:\d{2}:\d{2}
Replace with: <what/you/like>

Replaced Text


00.00.0000 00:00:00 Roses are Red
00.00.0000 00:00:00 Trees are Green
00.00.0000 00:00:00 Sky is Blue
00.00.0000 00:00:00 ...and a Black Hole is lurking in the centre of every fucking Galaxy!

Tutorial: How to use a compiled Matlab function in C#

In this small tutorial I will explain you:

• How to compile a Matlab function into a DLL
• Use the generated Matlab dll into a small C#-console program

Requirements:

• VisualStudio 2015 or greater
• Matlab 2018b 

Creating the .Net Matlab DLL

Create a matlab-file: MatlabThreeFunc.m

With the following content:

function [x2, sinx, expx]=MatlabThreeFunc(xIn)

% [x2, sinx, expx]=MatlabThreeFunc(xIn)

% Matlab test function

    x2=xIn.*xIn;

    sinx = sin(xIn);

    expx = exp(xIn);

end

As you see this simple function calculate the squared-, sin- and the exp- values of the input array xIn.

Navigate to the folder containing the file/function just created and execute the fololwing command:

mcc -W 'dotnet:MyMatlab.V2018b,WrapperClass,4.5,Private,local'  -T link:lib   ./MatlabThreeFunc.m;

This  will create a .Net dll, named V2018b.dll (version 4.5 of the Framework), containing a Class named WrapperClass and located in the namespace: MyMatlab.V2018b

In my My personal convention is to use part of the namespace (V2018b) to indicate which Matlab version I used to generate the dll. This is important when distributing your application. 

In my case, I want to run the application on other Computer I need to install the required Matlab Runtime 9.5 (=> https://www.mathworks.com/products/compiler/matlab-runtime.html)

Using the DLL in a C# project

Create a new Console Application:

Before you add a reference to the Just created DLL (=> V2018b.dll) it is important that you remove the VisualStudio default setting Prefer 32 Bit, otherwise you'll get a Runtime Type Exception from the Matlab dll. (=> Since Version 2015b, Matlab is ONLY 64 bit!)

Remove"Prefer 32Bit" 

Add the TWO Matlab-References to your project:

• V2018b.dll 
• MWArray.dll (this is located under :  C:\Program Files\MATLAB\R2018b\toolbox\dotnetbuilder\bin\win64\v4.0\MWArray.dll)

And now the code:

CODE:

using System;

using MathWorks.MATLAB.NET.Arrays;

namespace MatlabFuncInCSharp

{

    class Program

    {

        static void Main(string[] args)

        {

            Console.WriteLine("Running...");

            // a basic double-array for the tests

            double[] dArrayInput = new double[5] { 0.1, 0.2, 0.3, 0.4, 0.5 };

            // convert the C#-array into the equivalent MatLab class

            MWNumericArray matArrayInput = new MWNumericArray(dArrayInput);

            Console.WriteLine("Instantiating WrapperClass...");

            MyMatlab.V2018b.WrapperClass oWrapperClass = new MyMatlab.V2018b.WrapperClass();

           

            int iExpectedNumberOfOutputs = 3;  // we want ALL 3 outputs of "MatlabThreeFunc"

            Console.WriteLine("Callinng MatlabThreeFunc...");

            MWArray[] matOutput = oWrapperClass.MatlabThreeFunc(iExpectedNumberOfOutputs, matArrayInput);

            

            // matOutput contains 3 elements

            MWNumericArray matX2Array = (MWNumericArray)matOutput[0]; // casting required!

            MWNumericArray matSinXArray = (MWNumericArray)matOutput[1]; // casting required!

            MWNumericArray matExpXrray = (MWNumericArray)matOutput[2]; // casting required!

            Console.WriteLine("Converting output into C#-Arrays...");

            // back to the C#-world...

            double[] dX2array = (double[])matX2Array.ToVector(MWArrayComponent.Real);

            double[] dSinXarray = (double[])matSinXArray.ToVector(MWArrayComponent.Real);

            double[] dExpXarray = (double[])matExpXrray.ToVector(MWArrayComponent.Real);

            Console.WriteLine("Press any key to exit!");

            Console.ReadKey();

        }

    }

}

I hope you found this post useful. A small video would have been wayyyyyyyyyyy better but I don't have the time for it. 

References:

• Mathworks: https://www.mathworks.com/help/compiler_sdk/ml_code/mcc.html#butg_5w
• Mathworks' samples: C:\Program Files\MATLAB\R2018b\toolbox\dotnetbuilder\Examples\VS15\NET

C# Defining Application/User Settings: appSettings Vs. ApplicationSettings

Basically there are two WAYs to define settings for a C# Application:

Manually update the app.config xml file (and access the properties via ConfigurationManager.AppSettings["key1"]; )

<appSettings>
 <add key="key1" value="value1"/>
 <add key="key2" value="value2"/>
</appSettings>

Or you can Select your Project, then Properties and Settings:

( access the properties in the code with Properties.Settings.Default.TestEnvironment)

<applicationSettings>
    <Projectname.Properties.Settings>
        <setting name="TestEnvironment" serializeAs="String">
            <value>True</value>
        </setting>
    </Projectname.Properties.Settings>
</applicationSettings>

References:

• stackoverflow.com #1
• stackoverflow.com #2

Spectre and Meltdown Vulnerabilities

This is the link to the papers describing Spectre and Meltdown

https://meltdownattack.com/

Get the list of filenames in a folder

1) Open PowerShell
2) Navigate to the folder which content you wanna export
3) Type & Enter this command :

Get-Childitem -PAth . > C:\path\where\to\store\the\file\filenames.txt

That's it!

ORACLE PL/SQL ... if dbms_output.put_line('Hello World'); does not work...

If  dbms_output.put_line('Hello World'); in your PL/SQL script does not work, you probably forgot to activate the output in your SQLPLUS.exe or SQL Developer!


To activate the output, enter the following command:


set serveroutput on


Now you can execute your function/procedure:



begin
dbms_output.put_line('Hello World');
end;
/

C#: A Linear Regression example with the NelderMead solver from Microsoft Solver Foundation (MSF)

Given that you installed the Microsoft Solver Foundation (msdn.microsoft.com)
and referenced the MSF dll (Microsoft.Solver.Foundation.dll) in your VisualStudio Project here is a simple code to test the NonLinear solver (aka NelderMead solver)  that ships with the library.

I hope Microsoft will revive this nice library in the future (at the moment the project is abandoned :( )

// here is the code

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Threading.Tasks;
using Microsoft.SolverFoundation.Common;
using Microsoft.SolverFoundation.Services;
using Microsoft.SolverFoundation.Solvers;

namespace LinearRegressionMSF
{
    class Program
    {

    // We want to get a this line's coefficients back: y = 11.22*x + 77.99
   
        static double[] xData = new double[] { 0, 1, 2, 3, 4, 5, 6, 7 };
        static double[] yData = new double[] { 0 * 11.22 + 77.99, 1 * 11.22 + 77.99, 2 * 11.22 + 77.99, 3 * 11.22 + 77.99, 4 * 11.22 + 77.99, 5 * 11.22 + 77.99, 6 * 11.22 + 77.99, 7 * 11.22 + 77.99 };


        static void Main(string[] args)
        {

            LinearRegressionWithNelderMeadSolver();

            Console.ReadKey();
        }



        private static void LinearRegressionWithNelderMeadSolver()
        {
            // initial values for the two parameters
            double[] pInitial = new double[] { 1, 1 };
           
            // lower and upper limits for the two paramenters           
            double[] pLower = new double[] { -100, -100 };
            double[] pUpper = new double[] { 100, 100 };

            var solution = NelderMeadSolver.Solve(SumOfSquares, pInitial, pLower, pUpper);

            Console.WriteLine(solution.Result);
            Console.WriteLine("solution = {0}", solution.GetSolutionValue(0));
            Console.WriteLine("x = {0}", solution.GetValue(1));
            Console.WriteLine("y = {0}", solution.GetValue(2));
        }


        private static double SumOfSquares(double[] p)
        {
            double q = p[0];
            double m = p[1];

            double dSumOfSquares = 0;

            for (int i = 0; i < xData.Length; ++i)
            {
                dSumOfSquares += Math.Pow(yData[i] - m * xData[i] - q, 2);
            }

            return dSumOfSquares;
        }
    }

}

Entity Framework: Model successfully updated but changes are not available in code

I lost quite some time on this annoying issue that sometimes affects my VisualStudio 2015 with the Devart Oracle Driver for using Entity Framework.

My changes in the database (for example a modification of a view) were reflected ONLY in the entity framework model (after selecting the usual Update Model from Database...) but the modified classes WERE NOT available in the code!

The solution is very simple: "Run Custom Tool"

Select your model file (the one with extension with .edml), right click an choose "Run Custom Tool".

Now the changes to your database are available in your code too.

Source:

https://blog.jongallant.com/2012/08/entity-framework-manual-update/

Where is java on macOS?

Open the terminal and execute the following command:


/usr/libexec/java_home -v 1.7


It will locate the files corresponding to the provided java version.
 
Here the link for Java6 from Apple (useful is you want to install Matlab):

https://support.apple.com/kb/dl1572?locale=en_US

Excel-Files take way too to open [Windows 10 issue on Dell]

This is not strictly speaking a programming issue, but definitely something quite annoying.
On my Windows 10 on my DELL  OptiPlex,  opening an excel file used to take about 30 seconds! It didn't matter if the file was on a local or network folder!
The issue was, in my case, related to the Audio Driver. Yes! An issue with Excel was related to the Realtek Audio Driver!

Anyway, here is the Dell's post:

http://www.dell.com/support/article/de/de/debsdt1/sln306701/slow-performance-issues-in-excel-when-opening-saved-files?lang=en

Solution:

Find your Computer Version in http://www.dell.com/support/drivers/home and update your Audio Driver

C#: Import excel file as dataset using OLEDB

using System;
using System.Collections.Generic;
using System.Collections.ObjectModel;
using System.Data;
using System.Data.OleDb;
using System.Linq;
using System.Text;

namespace cltStammdatenImporterGUI
{
    public class ExcelFile
    {

        public static DataSet DataSetFromExcelFile(string sExcelFilename, string sExcelRange = "")
        {
            DataSet ds = new DataSet();

            string connectionString = @"Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + sExcelFilename + ";Extended Properties='Excel 12.0 XML;HDR=NO;IMEX=1;';";

            using (OleDbConnection conn = new OleDbConnection(connectionString))
            {
                conn.Open();
                OleDbCommand cmd = new OleDbCommand();
                cmd.Connection = conn;

                // Get all Sheets in Excel File
                DataTable dtSheet = conn.GetOleDbSchemaTable(OleDbSchemaGuid.Tables, null);

                // Loop through all Sheets to get data
                foreach (DataRow dr in dtSheet.Rows)
                {
                    string sheetName = dr["TABLE_NAME"].ToString();

                    if (!sheetName.EndsWith("$"))
                        continue;

                    // Get all rows from the Sheet. sExcelRange must be in the form A1:C10 or sim or just empty
                    cmd.CommandText = "SELECT * FROM [" + sheetName + sExcelRange + "]";

                    DataTable dt = new DataTable();
                    dt.TableName = sheetName;

                    OleDbDataAdapter da = new OleDbDataAdapter(cmd);
                    da.Fill(dt);

                    ds.Tables.Add(dt);
                }

                cmd = null;
                conn.Close();
            }

            return ds;
        }
}
}

[C#] How to fix the "Microsoft.ACE.OLEDB.12.0 provider is not registered on the local machine" error

If you are trying to read an excel file in C# and you get this error:

The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine.

You need to install "Microsoft Access Database Engine 2010 Redistributable" that is available at the Microsoft's website:


https://www.microsoft.com/en-in/download/details.aspx?id=13255

C# : How Convert doubles to strings ALWAYS with dots instead of commas

To convert a double to string ALWAYS with dots instead of commas (as it is used in some languages like Italian or German) you need to use an overloaded version of the ToString() method.



Example:

double dVal = 77.55;
string sVal = dVal.ToString(System.Globalization.CultureInfo.InvariantCulture);
// sVal will be  always "77.55"


or if you use System.Globalization


using System.Globalization;

double dVal = 77.55;
string sVal = dVal.ToString(CultureInfo.InvariantCulture);

How to implement Matlab-like Tic() and Toc() functions in C#

Tic() and Toc() functions are quite handy in Matlab and here is how you can get something similar in C#


using System;
using System.Diagnostics;

namespace MyTools
{
    class Perform
    {
        static Stopwatch stopWatch;

        public static void Tic()
        {
            stopWatch = new Stopwatch();
            stopWatch.Start();

        }

        public static void Toc()
        {
            TimeSpan ts = stopWatch.Elapsed;

            // Format and display the TimeSpan value.
            string elapsedTime = String.Format("{0:00}:{1:00}:{2:00}.{3:00}",
                ts.Hours, ts.Minutes, ts.Seconds,
                ts.Milliseconds / 10);

            // elapsed time since the last Tic()
            Console.WriteLine($"Elapsed time : {elapsedTime} ");

        }
    }
}

Now you can check the performance of your code with:

Perform.Tic();

// some code that takes some time to execute

Perform.Toc();

OR if you use the using static directive:


using static MyTools.Perform;

Tic();

// some code that takes some time to execute

Toc();

Happy programming!

Source:

msdn.microsoft.com