Found 40 bookmarks
Newest
Understanding Vitess | Vitess
Understanding Vitess | Vitess

"Vitess is a database solution for deploying, scaling and managing large clusters of MySQL instances. It's architected to run as effectively in a public or private cloud architecture as it does on dedicated hardware. It combines and extends many important MySQL features with the scalability of a NoSQL database. Vitess can help you with the following problems:

Scaling a MySQL database by allowing you to shard it, while keeping application changes to a minimum.
Migrating from baremetal to a private or public cloud.
Deploying and managing a large number of MySQL instances.

Vitess includes compliant JDBC and Go database drivers using a native query protocol. Additionally, it implements the MySQL server protocol which is compatible with virtually any other language.

Vitess has been serving all YouTube database traffic since 2011, and has now been adopted by many enterprises for their production needs."

Understanding Vitess | Vitess
Introducing Orchestrator: manage and visualize your MySQL replication topologies and get home for dinner | code.openark.org
Introducing Orchestrator: manage and visualize your MySQL replication topologies and get home for dinner | code.openark.org

"I'm happy to announce the availability of Outbrain's Orchestrator: MySQL replication management & visualization tool.

Orchestrator reads your replication topologies (give it one server - be it master or slave - in each topology, and it will reveal the rest). It keeps a state of this topology. It can continuously poll your servers to get an up to date topology map. It visualizes the topology in a clear and slick D3 tree. It allows you to modify your topology; move slaves around. You can use the command line variation, the JSON API, or you can use the web interface."

Introducing Orchestrator: manage and visualize your MySQL replication topologies and get home for dinner | code.openark.org
You Must Have A Killer In Your System – MySQL Diary
You Must Have A Killer In Your System – MySQL Diary
"It is a good idea to have a script killer that can kill these slow queries when necessary. Since a script killer will sacrifice the page that called the slow query, this concept works well where the slow query is called from very few and less trafficked pages. Killing these queries will allow more productive and more frequently called queries to execute while the slow query is being investigated."
You Must Have A Killer In Your System – MySQL Diary
mihasya's ishmael at master - GitHub
mihasya's ishmael at master - GitHub

This is a simple UI to put on top of the data that mk-query-digest outputs. It let's you browse the query report in a more readable fashion. The aim is to display all the information from the report in a readable, navigable way. This tool does not add anything to the mk-query-digest utility itself. It simply displays the data that the utility generates.

mihasya's ishmael at master - GitHub
Percona Server with XtraDB in Launchpad
Percona Server with XtraDB in Launchpad

"Percona Server with XtraDB" is a drop-in replacement for MySQL, with full backward compatibility.

Percona Server provides diagnostic tools useful to DBAs, and more tunability of server behavior. Also included is Percona's online backup utility XtraBackup, the open source tool for the XtraDB / InnoDB.

 Percona Server with XtraDB shows outstanding performance and scalability on today's high-end server systems with many CPUs and fast storage subsystems such as flash storage and SSD. Notable advantages include:

     Scalability: Handles more concurrent transactions, and scales up on powerful servers.      Performance: Fast IO path, improved internal cooperation, and fast checksums.      Flexibility: Variable page size, better table and buffer pool management, and configurable insert buffer.      Reliability: Resilience to corrupted data, and crash-safe transactional replication.      Management: Online backup, InnoDB table import/export, fast recovery, and configurable data dictionary.      Diagnostics: Improved profiling and instrumentation.

Percona Server with XtraDB in Launchpad
MySQLnd Plugins: Writing a MySQL Query Logger in PHP - ThinkPHP /dev/blog
MySQLnd Plugins: Writing a MySQL Query Logger in PHP - ThinkPHP /dev/blog
A new approach to implementing a query logger and potentially more complex features such as monitoring or read/write-splitting is the MySQLnd Userland Handler Extension (mysqlnd_uh, pecl website). The extension lets you register a PHP class as a proxy for every MySQLndconnection. Every call to a function to MySQLnd (usually indirect through mysqli, mysql, pdo_mysql) is passed to the PHP class, which then calls the original MySQLnd function. The extension makes it possible to use a custom userland class as a transparent proxy for all MySQLnd frontend (again mysqli, mysql, pdo_myslq). In the next section, I'll outline the requirements of mysqlnd_uh and show a sample implementation.
MySQLnd Plugins: Writing a MySQL Query Logger in PHP - ThinkPHP /dev/blog
patches:userstatv2 [Percona DokuWiki]
patches:userstatv2 [Percona DokuWiki]

This patch adds several INFORMATION_SCHEMA tables, several FLUSH and SHOW commands, and the userstat_running variable. These tables and commands can be used to understand the server activity better and identify the source of the load.

The functionality is disabled by default, and must be enabled by setting the userstat_running variable to ON. It works by keeping several hash tables in memory. To avoid contention over global mutexes, each connection has its own local statistics, which are occasionally merged into the global statistics, and the local statistics are then reset to 0.

patches:userstatv2 [Percona DokuWiki]
Pinba
Pinba
Pinba is a statistics server for PHP using MySQL as a read-only interface.\nIt accumulates and processes data sent over UDP by multiple PHP processes and displays statistics in a nice human-readable form of simple "reports", also providing read-only interface to the raw data in order to make possible generation of more sophisticated reports.\nWith Pinba extension users also can measure particular parts of the code using timers with arbitrary tags.\nPinba is not a debugging tool in a common sense, since you're not supposed to do debugging on production servers, but its main goal is to help developers to locate bottlenecks in realtime and direct developers' attention to the code that really needs it.
Pinba
Spock Proxy
Spock Proxy
Spock Proxy supports range-based horizontal paritioning of a large MySQL database. The proxy intercepts SQL queries from the client, sends queries to the correct databases based on how the database is partitioned, then aggregates the results from each database and returns them to the client as a regular MySQL result set.
Spock Proxy
mysql-snmp - monitoring MySQL with SNMP
mysql-snmp - monitoring MySQL with SNMP

mysql-snmp is a Net-SNMP Perl subagent that connects to a MySQL server and reports its statistics through SNMP. Additionally this project contains material to graph MySQL variables/counters in OpenNMS.

The graphs are based on the excellent MySQL Cacti Templates by Baron Schwartz.

mysql-snmp - monitoring MySQL with SNMP
mycheckpoint | openark forge
mycheckpoint | openark forge

mycheckpoint is an open source monitoring utility for MySQL, with strong emphasis on user accessibility to monitored data.

It is SQL oriented: charts, reports and advances metrics are generated on the fly with views. There is no need for an external program to diagnose the data. In fact, mycheckpoint’s main duty is to to a one-time creation of a special purpose schema.

mycheckpoint | openark forge
Schema Sync › a MySQL Schema Versioning and Migration Utility
Schema Sync › a MySQL Schema Versioning and Migration Utility
Schema Sync will generate the SQL necessary to migrate the schema of a source database to a target database (patch script), as well as a the SQL necessary to undo the changes after you apply them (revert script).Schema Sync does not alter your database. It only generates the .sql files containing the differences. You must apply the changes.All ADD|MODIFY COLUMN statements have the AFTER (or FIRST) SQL syntax even if no move is required.COMMENTS and AUTO_INCREMENT values are not by synced by default. See help (-h) for details.Schema Sync does not yet recognize Tables or Columns that have been renamed. A rename will result in the old table or column being dropped and the new one added.Partitions (MySQL 5.1+) are not yet supported
Schema Sync › a MySQL Schema Versioning and Migration Utility
Catching erroneous queries, without MySQL proxy at Xaprb
Catching erroneous queries, without MySQL proxy at Xaprb
MySQL Proxy is a really neat tool. I remember a few years back when I first saw Jan talking about it. Back in those days it was significantly different than it is now, but the concept remains the same: direct your database traffic through a man-in-the-middle. Chris Calender’s post on capturing erroneous queries with MySQL Proxy shows one use for Proxy. But wait. MySQL Proxy is just inspecting the MySQL protocol. And unless you’re using it for something else too, having a man in the middle to catch errors is like standing in the middle of the street and blocking traffic to count the cars on the street. Why don’t you stand on the sidewalk to count the cars instead?
Catching erroneous queries, without MySQL proxy at Xaprb
DRBD limitations (or are they?) « Florian’s blog
DRBD limitations (or are they?) « Florian’s blog
I’ve recently received one database admin’s personal list of DRBD’s perceived limitations. While I’m certainly the last person to say that DRBD is limitation-free (hey, it’s software), I’d like to address these specifically — because really, in my humble opinion, most of them aren’t limitations at all.
DRBD limitations (or are they?) « Florian’s blog
kontrollbase | kontrollsoft
kontrollbase | kontrollsoft
Kontrollbase is a MySQL monitoring, analytics, reporting, and historical analysis webapp for MySQL database administrators and advanced users of MySQL databases. Its goal is to give you enterprise level tools that are built on the open-source software model. We want your servers to perform at their best and these tools will help you get the most out of your investment.
kontrollbase | kontrollsoft
Nagios MySQL Plug-Ins | Pablowe
Nagios MySQL Plug-Ins | Pablowe
There currently exist many plugins for MySQL to use with Nagios. Many of them, however, are not version-independent, leaving organizations that use multiple versions of MySQL to either install multiple plugins or not monitor specific versions of MySQL. As such, I’ve compiled what I consider to be the most useful checks into a single plugin: check_mysql
Nagios MySQL Plug-Ins | Pablowe
Open source utilities | openark forge
Open source utilities | openark forge

The openark kit is a set of utilities for MySQL. They solve everyday maintenance tasks, which may be complicated or time consuming to work by hand.

The available tools are:

* oak-apply-ri: apply referential integrity on two columns with parent-child relationship.
* oak-block-account: block or release MySQL users accounts, disabling them or enabling them to login.
* oak-kill-slow-queries: terminate long running queries.
* oak-modify-charset: change the character set (and collation) of a textual column.
* oak-purge-master-logs: purge master logs, depending on the state of replicating slaves.
* oak-security-audit: audit accounts, passwords, privileges and other security settings.
* oak-show-limits: show AUTO_INCREMENT “free space”.
* oak-show-replication-status: show how far behind are replicating slaves on a given master.
Open source utilities | openark forge
monolith-toolkit - Google Code
monolith-toolkit - Google Code

A collection of scripts for making your daily MySQL DBA responsibilities easier.

* mt-backup-parallel -> runs mysql backups in parallel super fast, has lots of reporting features
* mt-check-replication -> script to report on replication status for slave servers
* mt-rhcluster-check-filesystems -> reports on redhat cluster filesystems (for mysql active/passive clustering)
* mt-rhcluster-script-wrapper -> wrapper script for running any of these scripts on a redhat cluster, chooses the active node to run the script on
* mt-connections-log -> logs connections to mysql to disk, reports on threshold overages
* mt-flush-tables-sequence -> runs through schema.tables to flush in sequence before global flush
* mt-rotate-logs -> rotates general and slow query logs on periodic basis
* mt-my.cnf_xG -> MySQL configuration file for a particular RAM size installation
monolith-toolkit - Google Code
Racker Hacker » MySQLTuner v0.9.1
Racker Hacker » MySQLTuner v0.9.1
MySQLTuner is a high-performance MySQL tuning script written in perl that will provide you with a snapshot of a MySQL server’s health. Based on the statistics gathered, specific recommendations will be provided that will increase a MySQL server’s efficiency and performance. The script gives you automated MySQL tuning that is on the level of what you would receive from a MySQL DBA.
Racker Hacker » MySQLTuner v0.9.1