Jeremy D. Miller On System Design Video Playlist

-

Comments

Post a Comment

Popular posts from this blog

Pickle Vs M, VS ONNX vs SavedModel vs TorchScript

-
  Pickle Vs M, VS  ONNX vs SavedModel vs TorchScript Let’s break it down in terms of purpose, use cases, compatibility, and safety : 🥒 Pickle (.pkl) Pickle is a Python-specific serialization format for objects, including machine learning models. Feature Details Use Case Serializing Python objects (including scikit-learn, XGBoost models) Compatibility Python-only (tight coupling with specific versions) Frameworks scikit-learn, XGBoost, LightGBM, etc. Speed Fast to load/save Portability ❌ Low — not portable across languages or platforms Security ⚠️ Unsafe to unpickle untrusted data (can execute arbitrary code) Deployment Typically for offline inference or Python-based pipelines ✅ Best For : Local development, internal tools, reproducible experiments ❌ Not Ideal For : Cross-platform deployment, mobile/edge/cloud scaling 🧠 TensorFlow SavedModel (MD) SavedModel is TensorFlow’s official format for storing trained models for production use. ...
Read more

Experiment Tracking and Versioning during Model Training

-
 Experiment Tracking and Versioning during Model Training Experiment Tracking   Following is just a short list of things you might want to consider tracking for each experiment during its training process:  • The loss curve corresponding to the train split and each of the eval splits.  • The model performance metrics that you care about on all nontest splits, such as accuracy, F1, perplexity. • The log of corresponding sample, prediction, and ground truth label. This comes in handy for ad hoc analytics and sanity check • The speed of your model, evaluated by the number of steps per second or, if your data is text, the number of tokens processed per second.  • System performance metrics such as memory usage and CPU/GPU utilization. They’re important to identify bottlenecks and avoid wasting system resources.  • The values over time of any parameter and hyperparameter whose changes can affect your model’s performance, such as the learning rate if you use...
Read more

Bookmark

-
Good Blog about Architecture & design Patterns:   http://martinfowler.com/bliki/ http://www.sharepoint-videos.com/ http://go.cloudshare.com/Linkedin_ProPlus_SharePoint.html A Technical Q/A site: http://www.bookmarkresource.com http://blog.krisvandermast.­ com/ASPNET20PageLifeCycle.aspx http://blogs.vertigosoftware.­ com/shannonf/archive/2005/08/­ 07/1355.aspx http://john-sheehan.com/blog/­ net-cheat-sheets/ http://www.eggheadcafe.com/­ articles/20051227.asp http://duartes.org/gustavo/­ articles/Asp.net-Runtime-­ Cheat-Sheet-HttpRequest-­ HttpRuntime.aspx http://www.addedbytes.com/­ cheat-sheets/javascript-cheat- ­sheet/ http://www.antsmagazine.com/­ 2009/04/100-useful-cheat-­ sheets-for-web-designers-­ developers/ Nice link abt .Net 3.5: http://www.simple-talk.com/ dotnet/.net-framework/.net-3. 5-language-enhancements/ nice articles about JQuery. http://encosia.com/2008/05/29/ using-jquery-to-directly-call- aspnet-ajax-page-methods/ http://encosi...
Read more