additive function

Additive functions are functions which satisfy the condition f(x+y) = f(x) + f(y) for any x and y. Additive functions are linear functions.

convex function

A convex function is a function which features a single global minimum, whereas a non-convex functions presents many local minima. A good analysis on the mathematical aspects and mathematical definition of convex and non-convex functions can be found at: https://rumn.medium.com/convex-vs-non-convex-functions-why-it-matters-in-optimization-for-machine-learning-39cd9427dfcc. Some examples of ML algorithms which have restrictions related to convex functions are the following: ... Read more

linear regression

Linear regression is a statistical modeling technique. It utilizes a dependent variable, which can be discrete or continuous number and one independent variable. Linear regression models are simple to train by using machine learning. In many cases are the first type of machine learning models to try to train when using a new data set. ... Read more

tanh function

The tanh function, also known as the hyperbolic tangent function, is an activation function in artificial neural networks whose output values are constrained between the values of −1 and 1. The following screenshot provides a graph of function f(x)=tanh(x), as output from the Geogebra free online calculator.

target function

In machine learning, the target function is a mathematical representation of the relationship between an ML model's input variables and output variables, which best approximates some desired outcome from a machine learning model.