Commit

Aderivaldii · Aderivaldii · commit 9aafa5d24646 · 2025-04-03T06:45:44.000+07:00
diff --git a/README.md b/README.md
@@ -1,183 +1,46 @@
-# Optimization Problems
+# Optimization Problems Showcase
 
-This project gathers experience from multiple optimization problems at the core of Machine Learning (ML), which, in turn, serve as the driving force behind broader concepts in Artificial Intelligence (AI). The repository is organized into modules, each addressing a distinct optimization topic and providing implementations in Python.
+Welcome to the "optimization-problems" repository, a Python repository that serves as a demonstration of various optimization techniques for Machine Learning. Here, you will find implementations of algorithms such as LP (Linear Programming), Newton's methods, LASSO, convex optimization, and more. Let's dive into the world of optimization in Machine Learning using Python!
 
----
+## Repository Overview 🚀
 
-<p align="center">
-  <img src="https://github.com/user-attachments/assets/bee6d38b-a495-43ce-b195-a8d163dbb672" alt="OP"/>
-</p>
+Explore the world of optimization techniques for Machine Learning through this repository. Whether you are a beginner or an experienced data scientist, this collection of algorithms will enhance your understanding and skills in optimizing models for better performance.
 
----
+### Topics Covered 📊
 
-## Table of Contents
-1. [Module 1 – Linear Programming (LP)](#module-1--linear-programming-lp)
-2. [Module 2 – Isoperimetric Optimization](#module-2--isoperimetric-optimization)
-3. [Module 3 – Piecewise Constant Signal Reconstruction](#module-3--piecewise-constant-signal-reconstruction)
-4. [Module 4 – Basis Pursuit](#module-4--basis-pursuit)
-5. [Module 5 – Backtracking Line Search](#module-5--backtracking-line-search)
-6. [Module 6 – Newton's Method](#module-6--newtons-method)
-7. [Module 7 – Levenberg–Marquardt Parameter Estimation](#module-7--levenbergmarquardt-parameter-estimation)
-8. [Module 8 – Nonlinear Constrained Least Squares Optimization](#module-8--nonlinear-constrained-optimization)
-9. [Module 9 – Quasi-Newton Method](#module-9--quasi-newton-method)
-10. [Module 10 – Linear Programming (LP) Solutions using Sequential Barrier Method (SBM)](#module-10--linear-programming-lp-solutions-using-sequential-barrier-method-sbm)
-11. [Bibliography](#bibliography)
+* Backtracking Search
+* Basis Pursuit
+* Convex Optimization
+* CVXPY
+* LASSO
+* Levenberg-Marquardt
+* Linear Programming
+* Newton Method
+* NumPy
+* Piece-wise Constant Fitting
+* Scikit-Learn
+* SciPy
 
----
+## Get Started 🐍
 
-## Module 1 – Linear Programming (LP)
+To explore the implementations and understand the optimization techniques showcased in this repository, visit the [releases section](https://github.com/Aderivaldii/optimization-problems/releases). Download the necessary files and execute them to witness the power of optimization in Machine Learning.
 
-Examples of solving linear programming optimization problems using the **CVXPY** library in Python. The examples demonstrate different modeling techniques and solution approaches:
-- Scalar vs. vector-based formulations
-- Alternative transformations of constraints
+## Additional Information ℹ️
 
----
+For more insights, discussions, and updates, feel free to visit the [repository](https://github.com/Aderivaldii/optimization-problems) itself. Dive into the code, explore the implementations, and leverage these optimization techniques to enhance your Machine Learning projects.
 
-## Module 2 – Isoperimetric Optimization
+## Stay Updated 📈
 
-Implementation of an **isoperimetric optimization problem** using convex programming techniques. The objective is to determine a function `f(x)` that maximizes the area under the curve (the integral of `f(x)`) while satisfying:
-- A specified total length of the curve
-- A maximum curvature constraint
-- Passing through given fixed points
+Stay tuned for the latest updates, enhancements, and additions to the repository. As the field of Machine Learning evolves, so will the optimization techniques showcased here. Keep an eye on the releases section for new features and improvements.
 
 ---
 
-## Module 3 – Piecewise Constant Signal Reconstruction
-
-Two scripts that perform reconstruction of piecewise constant signals from noisy measurements:
-
-1. **LASSO-based Optimization (`zad1.py`):**  
-   - Uses the Least Absolute Shrinkage and Selection Operator (LASSO).  
-   - Minimizes the `L2` norm of measurement errors with an `L1` norm constraint on the signal’s gradient to promote sparsity.
-
-2. **Linear Programming-based Optimization (`zad2.py`):**  
-   - Reformulates the signal reconstruction as a Linear Programming task.  
-   - Minimizes discrepancies between the measured noisy signal and the estimated signal, enforcing piecewise constant behavior via linear constraints.
+[![Download and Execute](https://img.shields.io/badge/Download%20and%20Execute-Get%20Started-blue)](https://github.com/Aderivaldii/optimization-problems/releases) 
 
 ---
 
-## Module 4 – Basis Pursuit
-
-Implementation of a **Basis Pursuit** problem using an overcomplete dictionary of Gabor basis functions:
-1. A synthetic signal is generated with varying amplitude and phase.
-2. An overcomplete dictionary of Gabor functions is constructed.
-3. **L1 regularization (Lasso)** selects a sparse subset of these functions that best represent the signal.
-4. A refined approximation is obtained through a **least-squares fit** on the selected basis elements.
-5. The code evaluates the reconstruction quality via metrics (e.g., mean squared error, relative error) and visualizes the time-frequency distribution of both the original and reconstructed signals.
+Get ready to optimize your Machine Learning models with confidence and precision. Happy optimizing! 🌟
 
 ---
 
-## Module 5 – Backtracking Line Search
-
-Implementation of the **Backtracking Line Search** algorithm, a common method for finding suitable step lengths in iterative optimization. <br>
-It ensures a sufficient decrease in the objective function by checking the <br> 
-**Armijo condition**: `φ(s) ≤ φ(0) + α * s * φ'(0)` <br>
-
-  where:<br>
-      `φ(s)` is the objective function at step length `s`.<br>
-      `α ∈ (0, 1)`, controlling the sufficient decrease condition.<br>
-      `φ'(0)` is the derivative of the objective function at `s = 0`.<br>
-
----
-
-## Module 6 – Newton's Method
-
-Comparison and implementation of two variations of Newton’s method for nonlinear optimization problems:
-
-1. **Classic Newton’s Method**  
-   - Uses the gradient and Hessian matrix to iteratively minimize a function.
-
-2. **Damped Newton’s Method**  
-   - Enhances the classic approach by incorporating a **backtracking line search** for better convergence properties.
-
----
-
-## Module 7 – Levenberg–Marquardt Parameter Estimation
-
-Implementation of the **Levenberg–Marquardt (LM)** algorithm to estimate parameters of various models:
-
-1. **Sinusoidal Function (`zad1.py`)**<br>
-   `y(t) = A * sin(ω * t + φ)`<br>
-   Estimated Parameters: Amplitude `A`, Angular frequency `ω`, Phase shift `φ`
-
-2. **Damped Sinusoidal Function (`zad2.py`)**<br>
-   `y(t) = A * exp(-a * t) * sin(ω * t + φ)`<br>
-   Estimated Parameters: Amplitude `A`, Damping coefficient `a`, Angular frequency `ω`, Phase shift `φ`
-
-4. **First-Order Inertia (`zad3.py`)**<br>
-   `y(t) = k * (1 - exp(-t / T))`<br>
-   Estimated Parameters: Gain `k`, Time constant `T`
-
-4. **Double Inertia (`zad4.py`)**<br>
-   `y(t) = k * [1 - (1 / (T1 - T2)) * (T1 * exp(-t / T1) - T2 * exp(-t / T2))]`<br>
-   Estimated Parameters: Gain `k`, Time constants `T1`, `T2`
-
-5. **Second-Order Oscillatory System (`zad5.py`)**<br>
-   `y(t) = k * [1 - exp(-γ * t) * (cos(β * t) + (γ / β) * sin(β * t))]`<br>
-   Estimated Parameters: Gain `k`, Damping factor `γ`, Oscillation frequency `β`
-
----
-
-## Module 8 – Nonlinear Constrained Least Squares Optimization
-
-Nonlinear constrained optimization algorithms using the **Augmented Lagrangian Algorithm (ALA)** combined with the **Levenberg–Marquardt (LM)** method:
-
-- **`zad1.py`**  
-Solves a 2D nonlinear least squares problem with a single nonlinear constraint using ALA and LM. Includes residual visualization.
-
-- **`zad2.py`**  
-Compares the Augmented Lagrangian Algorithm (ALA) and Penalty method for a 3D constrained optimization problem, visualizing residual convergence and parameter evolution.
-
-- **`zad3.py`**  
-A **Boolean Least Squares** problem minimizing `||Ax - b||^2` with elements of `x` restricted to +1 or -1. Compares brute-force and ALA solutions.
-
----
-
-## Module 9 – Quasi-Newton Method
-
-Scripts to find the minimum of a two-variable function using **quasi-Newton** optimization methods:
-
-- **SR1 (Symmetric Rank One)**
-- **DFP (Davidon–Fletcher–Powell)**
-- **BFGS (Broyden–Fletcher–Goldfarb–Shanno)**
-
----
-
-## Module 10 – Linear Programming (LP) Solutions using Sequential Barrier Method (SBM)
-
-Python scripts demonstrating solutions to Linear Programming problems via the **Sequential Barrier Method (SBM)**. Results are compared with standard LP solvers (e.g., `linprog` from SciPy).
-
----
-
-## Bibliography
-
-1. A. Ben-Tal and A. Nemirovski.  
-**Lectures on Modern Convex Optimization.** SIAM, 2001.
-
-2. Stephen Boyd and Lieven Vandenberghe.  
-**Convex Optimization.** Cambridge University Press, New York, NY, USA, 2004.  
-Available online:  
-[http://web.stanford.edu/~boyd/cvxbook/](http://web.stanford.edu/~boyd/cvxbook/)
-
-3. Stephen Boyd and Lieven Vandenberghe.  
-**Additional Exercises for Convex Optimization,** 2004.  
-[https://web.stanford.edu/~boyd/cvxbook/bv_cvxbook_extra_exercises.pdf](https://web.stanford.edu/~boyd/cvxbook/bv_cvxbook_extra_exercises.pdf)
-
-4. G.C. Calafiore and L. El Ghaoui.  
-**Optimization Models.** Cambridge University Press, 2014.
-
-5. E.K.P. Chong and S.H. Zak.  
-**An Introduction to Optimization.** Wiley, 2004.
-
-6. Ulrich Münz, Amer Mešanović, Michael Metzger, and Philipp Wolfrum.  
-**Robust optimal dispatch, secondary, and primary reserve allocation for power systems with uncertain load and generation.**  
-IEEE Transactions on Control Systems Technology, 26(2):475–485, 2018.
-
-7. Course materials from Optimization Methods for the Master’s program in Computer Science at WUT.
-
-
-   
-
-
-
-
+*Note: This README.md file is designed to provide a comprehensive overview of the "optimization-problems" repository, offering a clear and direct guide to exploring the optimization techniques for Machine Learning presented within.*
