Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

Commit

Permalink
exp3 graphs
Browse files Browse the repository at this point in the history
  • Loading branch information
taivop committed Nov 20, 2016
1 parent 4f00864 commit 11570ae
Show file tree
Hide file tree
Showing 2 changed files with 39 additions and 2 deletions.
Binary file modified report/milestone2.pdf
Binary file not shown.
41 changes: 39 additions & 2 deletions report/milestone2.tex
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ \section*{Definitions and setup}
\item The middleware was run on Basic A4 instances, and both memaslap and memcached were run on Basic A2 instances.
\item The first 2 and last 2 minutes of each experiment were discarded from analyses as warm-up and cool-down time.
\item The request sampling rate for logging is set to $\frac{1}{100}$ in throughput experiments (Section~\ref{sec:exp1}) and $\frac{1}{10}$ in replication and write proportion experiments (Sections~\ref{sec:exp2} and \ref{sec:exp3}).
\item We are dealing with a closed system because memaslap clients wait for a response before sending a new request.
\item The system is closed because memaslap clients wait for a response before sending a new request.
\end{itemize}


Expand All @@ -113,7 +113,7 @@ \subsection{Experimental question}

In this section, I will run experiments to find out a) the maximum throughput of the SUT, b) the number of read threads ($T$) in the middleware that achieves this c) the number of virtual clients ($C$) that achieves this.

To this end, I will measure throughput as a function of $T$ and $C$, in 10-second time windows. I will find the maximum sustained throughput of the SUT, i.e. the throughput at which the response time does not increase rapidly with \todo{additional clients}. For each parameter combination, I will run experiments until the 95\% confidence interval (calculated using a two-sided t-test) lies within 5\% of the mean throughput.
To this end, I will measure throughput as a function of $T$ and $C$, in 10-second time windows. I will find the maximum sustained throughput of the SUT, i.e. the throughput at which the response time does not increase rapidly with additional clients. For each parameter combination, I will run experiments until the 95\% confidence interval (calculated using a two-sided t-test) lies within 5\% of the mean throughput.

\subsection{Hypothesis}

Expand Down Expand Up @@ -376,6 +376,43 @@ \subsection{Experiments}
\subsection{Results}
Reporting experiment results. Comparison of hypothesis and experiment results.

\todo{Analyse results}

\begin{figure}[h]
\centering
\includegraphics[width=\textwidth]{../results/writes/graphs/response_time_vs_writes_get.pdf}
\caption{caption \todo{}}
\label{fig:exp3:res:responsetime:get}
\end{figure}

\begin{figure}[h]
\centering
\includegraphics[width=\textwidth]{../results/writes/graphs/response_time_vs_writes_set.pdf}
\caption{caption \todo{}}
\label{fig:exp3:res:responsetime:set}
\end{figure}

\begin{figure}[h]
\centering
\includegraphics[width=\textwidth]{../results/writes/graphs/throughput_vs_writes.pdf}
\caption{caption \todo{}}
\label{fig:exp3:res:throughput}
\end{figure}

\begin{figure}[h]
\centering
\includegraphics[width=\textwidth]{../results/writes/graphs/time_breakdown_vs_writes_set_abs.pdf}
\caption{caption \todo{}}
\label{fig:exp3:res:breakdown:set:abs}
\end{figure}

\begin{figure}[h]
\centering
\includegraphics[width=\textwidth]{../results/writes/graphs/time_breakdown_vs_writes_set_rel.pdf}
\caption{caption \todo{}}
\label{fig:exp3:res:breakdown:set:rel}
\end{figure}


\pagebreak

Expand Down

0 comments on commit 11570ae

Please sign in to comment.